-- Logs begin at Wed 2022-08-17 10:41:58 UTC, end at Wed 2022-08-17 11:41:17 UTC. -- Aug 17 11:07:43.157685 dv-cinder-853450-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 11:07:43.166169 dv-cinder-853450-1-smb devstack@keystone.service[81448]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 11:07:43.168780 dv-cinder-853450-1-smb devstack@keystone.service[81448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 11:07:43 2022] *** Aug 17 11:07:43.168925 dv-cinder-853450-1-smb devstack@keystone.service[81448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 11:07:43.169032 dv-cinder-853450-1-smb devstack@keystone.service[81448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 11:07:43.169136 dv-cinder-853450-1-smb devstack@keystone.service[81448]: nodename: dv-cinder-853450-1-smb Aug 17 11:07:43.169237 dv-cinder-853450-1-smb devstack@keystone.service[81448]: machine: x86_64 Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: clock source: unix Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: pcre jit disabled Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: detected number of CPU cores: 4 Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: current working directory: / Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: detected binary path: /usr/bin/uwsgi-core Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: your processes number limit is 47680 Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: your memory page size is 4096 bytes Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: detected max file descriptor number: 2048 Aug 17 11:07:43.169357 dv-cinder-853450-1-smb devstack@keystone.service[81448]: lock engine: pthread robust mutexes Aug 17 11:07:43.169849 dv-cinder-853450-1-smb devstack@keystone.service[81448]: thunder lock: enabled Aug 17 11:07:43.169849 dv-cinder-853450-1-smb devstack@keystone.service[81448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 11:07:43.169849 dv-cinder-853450-1-smb devstack@keystone.service[81448]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 11:07:43.208867 dv-cinder-853450-1-smb devstack@keystone.service[81448]: Python main interpreter initialized at 0x55de15ff59c0 Aug 17 11:07:43.208867 dv-cinder-853450-1-smb devstack@keystone.service[81448]: python threads support enabled Aug 17 11:07:43.208867 dv-cinder-853450-1-smb devstack@keystone.service[81448]: your server socket listen backlog is limited to 100 connections Aug 17 11:07:43.208867 dv-cinder-853450-1-smb devstack@keystone.service[81448]: your mercy for graceful operations on workers is 90 seconds Aug 17 11:07:43.209203 dv-cinder-853450-1-smb devstack@keystone.service[81448]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 11:07:43.209279 dv-cinder-853450-1-smb devstack@keystone.service[81448]: *** Operational MODE: preforking *** Aug 17 11:07:43.209548 dv-cinder-853450-1-smb devstack@keystone.service[81448]: *** uWSGI is running in multiple interpreter mode *** Aug 17 11:07:43.209548 dv-cinder-853450-1-smb devstack@keystone.service[81448]: spawned uWSGI master process (pid: 81448) Aug 17 11:07:43.209752 dv-cinder-853450-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 11:07:43.210771 dv-cinder-853450-1-smb devstack@keystone.service[81448]: spawned uWSGI worker 1 (pid: 81459, cores: 1) Aug 17 11:07:43.210771 dv-cinder-853450-1-smb devstack@keystone.service[81448]: spawned uWSGI worker 2 (pid: 81460, cores: 1) Aug 17 11:07:43.210771 dv-cinder-853450-1-smb devstack@keystone.service[81448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 11:07:47.454757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:07:47.454757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Aug 17 11:07:47.455687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:07:47.455687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Aug 17 11:07:47.458254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:07:47.458254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Aug 17 11:07:47.458773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 11:07:47.458773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Aug 17 11:07:47.504867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:07:47.505075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:07:47.505230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] command line args: [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:07:47.505488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:07:47.505619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ================================================================================ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:07:47.505782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 11:07:47.505887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.505958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 11:07:47.506088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_dir = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.506174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] command line args: [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 11:07:47.506284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.506373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 11:07:47.506452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_source = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.506608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ================================================================================ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 11:07:47.506697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] debug = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.506806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_dir = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_source = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] debug = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.507941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_config_append = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_dir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.508957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_config_append = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_dir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.509942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.510894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.511805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] publish_errors = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.512933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] publish_errors = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.513978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] standard_threads = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] standard_threads = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.514910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_journal = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.515020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.515181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_json = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.515181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_stderr = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.515901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_syslog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_journal = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_json = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.516719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_stderr = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.516940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_syslog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.516940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 11:07:47.517163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.517916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.518920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.519968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.520978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.521961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.522947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.523955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.524947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.525917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.526999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.527957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.528999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.529941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.530895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.531057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.531287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.531749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.531872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.532958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.533978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.534888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.535970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.536889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.537908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.538889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.539946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.540996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.external = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.external = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.541791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.password = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.token = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.password = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.token = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.542948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.543985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.544892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.545925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.546037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.546155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.546308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.546839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.546981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.547905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.548954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.549986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.550968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.551886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.552948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.553970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.554893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.555906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.556942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.557966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.558992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.559965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.560888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.561918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.562116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.562713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.562840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.562965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.563882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.564923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.565911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.566928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.567852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.568948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.569981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.570906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.571971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.572999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.573909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.574941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.575974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.576902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.577985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.578932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.579984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.580903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.581927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.582944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.583738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.584984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.585937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.586984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.587908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.588859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.589936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.590958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.591846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:07:47.592100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 11:07:47.592100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 11:07:47.617796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.618021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.618108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.618244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.618329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.618465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.626978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.627198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.654739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.654961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.655131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.655325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.707790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.708279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.756318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.756567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.761524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.761761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.916740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.916948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.917883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.918003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.940978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.941986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.942055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.942129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.942256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.942336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.942401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.953346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.953734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.965917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.966967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.967128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.967255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.967410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.967577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.967761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 11:07:47.983926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.984161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 11:07:47.984481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.984681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.984769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 11:07:47.984833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 11:07:47.984934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 11:07:47.985339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.985998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.986197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.986479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.995271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.995547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.995813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.996116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.996242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.996453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.996715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:47.996996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.003105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.004143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.006005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.006289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.006575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.006854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.006979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.007116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.007883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.008971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.009242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.009515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.009785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.031657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.032605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.033125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.033408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.034053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.034334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.038023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.038301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.038581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.038973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.039256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.039534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.044902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.045187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.045864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.046148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.049345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.049629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.049910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.050192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.050731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.050858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.051799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.052110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.052374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.052640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.068577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.068823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.070076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.070367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.072999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.074732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.076194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.076489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.078271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.078571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.080744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.083849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.086943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.088529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.088834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.089113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.089406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.089683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.089955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.090081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.093365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.093824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.094237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.094526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.094806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.095092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.108234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.108523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.108786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.109112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.110958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.111245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.111507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.111767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.115952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.117468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.117741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.118607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.120143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.120361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.120449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.120625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.120904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.121204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.121479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.123027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.123311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.123592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.123887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.124185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.132803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.133081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.133360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.133635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.133920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.134194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.134468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.135793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.136095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.136346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.136621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.136899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.137183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.137463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.150318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.152853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.153362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.156005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.156354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.157933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.158877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.159400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.159680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.159975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.160331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.161776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.162057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.162349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.166446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.167885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.168776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.170220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.170776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.171071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.171516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.171964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.173130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.173417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.173701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.173962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.180246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.180532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.180810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.182231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.182517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.182796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.187714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.188019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.188304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.188576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.188847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.189092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.189380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.189658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.189865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 11:07:48.189967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.190958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.191957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.192267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.192518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.192775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.193057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.193320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 11:07:48.225183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de15ff59c0 pid: 81459 (default app) Aug 17 11:07:48.226978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de15ff59c0 pid: 81460 (default app) Aug 17 11:07:48.230501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a01e38-5d4c-43ad-b2b6-4d23f6ac3a1d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:48.230787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a01e38-5d4c-43ad-b2b6-4d23f6ac3a1d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:48.231058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a01e38-5d4c-43ad-b2b6-4d23f6ac3a1d None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:48.235368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Aug 17 11:07:48 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:07:54.805722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:54.806522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:54.806635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:54.813858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:07:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:07:54.822682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:54.823398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:54.823902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:54.897097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: INFO dbcounter [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] Registered counter for database keystone Aug 17 11:07:54.918880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG oslo_db.sqlalchemy.engines [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:07:54.930897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writer thread running {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:07:55.117424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81459) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 11:07:55.117755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81459) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 11:07:55.189029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:07:55.190657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:07:55.332407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:07:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 11:07:55.634309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:07:55.705418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: INFO dbcounter [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] Registered counter for database keystone Aug 17 11:07:55.730598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 11:07:55.740561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writer thread running {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 11:07:55.863566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d39ff6-140b-44c7-a576-e3e38d9d610b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:07:55.869262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:07:55.869919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:55.870196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:55.870462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:55.879612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:07:55.931031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 11:07:55.931311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66de4-fe8e-4bc9-9daf-acb3e03309e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:07:55.942081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 17 11:07:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:07:55.952431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:07:55.972102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156816e-9d53-48aa-9891-3973e91b8839 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:07:55.977563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:07:55.978686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:55.978962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:55.979228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] PATH_INFO: `/v3/projects/28f251e503a640598b723ca0a0d78c6b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:55.980944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] RBAC: Authorizing `identity:get_project(project_id=28f251e503a640598b723ca0a0d78c6b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:07:56.033565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING keystone.common.rbac_enforcer.enforcer [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 11:07:56.033905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c8e66-9c9f-4865-9534-06ba07e3a798 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:07:56.038526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Aug 17 11:07:55 2022] GET /identity/v3/projects/28f251e503a640598b723ca0a0d78c6b => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:07:57.907209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c61c-7dba-4b84-ad52-c5f08ec4361c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:57.908140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c61c-7dba-4b84-ad52-c5f08ec4361c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:57.908140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7c61c-7dba-4b84-ad52-c5f08ec4361c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:57.914875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:07:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:07:57.921350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:57.921806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:57.921900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:57.948156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:07:57.949669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:07:57.958364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:07:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 11:07:58.222455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7c61c-7dba-4b84-ad52-c5f08ec4361c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:07:58.244209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7c61c-7dba-4b84-ad52-c5f08ec4361c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:07:58.251048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:07:58.251648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:58.251952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:58.252221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:58.260509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:07:58.262291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468f2ba-b642-454a-ac52-660c090a2da8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:07:58.271537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 17 11:07:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:07:58.280186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:07:58.295177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553abde-b98b-4958-87c2-7c16fc9f3b79 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:07:58.301419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:07:58.302051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:07:58.302329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:07:58.302588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:07:58.304092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:07:58.305926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1293-76f5-40a1-a172-4bce0db95a98 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:07:58.307448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Aug 17 11:07:58 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:00.240915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e53521-30a6-4846-876e-2bd5cce0a90d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.241482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e53521-30a6-4846-876e-2bd5cce0a90d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.241482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e53521-30a6-4846-876e-2bd5cce0a90d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.242799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:00.248241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.249173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.249173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.268072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:00.269268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:00.280794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec992b5-4307-45e6-b6c9-68f628fa3c58 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.281079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec992b5-4307-45e6-b6c9-68f628fa3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.281353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec992b5-4307-45e6-b6c9-68f628fa3c58 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.282700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:00.287716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.288033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.288312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.334421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81460) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 11:08:00.334851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81460) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 11:08:00.351283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:00.380038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:00.381629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:00.482122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:00.624912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:00.649786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:00.736862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae9c9e-65f3-4f6e-8367-24ff2080da64 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:00.745554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:00.772834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:00.773475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.773755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.774020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.785469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:00.794177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:00.795074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:00.796024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:00.801683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:00.852591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec24ff-ee36-409e-8be7-813cae79fc51 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:00.854833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:00.884009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:00.889144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:00.890011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.890288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.890559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.902969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120ac48-f0c3-41ef-83db-a032b3e213bb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:00.936477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:00.937220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:00.937503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:00.937773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:00.938455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:00.938758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:00.940196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:00.951963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:00.957485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:00.962470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:00.964019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.055819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661c0fc-bf9c-45ca-8230-df77b23d6f1e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:01.061680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:01.067238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:01.069946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:01.090640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:01.091279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:01.091560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:01.091836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:01.093123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:01.094660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.096274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:00 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:01.101776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:01.116343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:01.167878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f52a68-b842-4bdf-b249-fae56ff5f342 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:01.200296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40612d6b-55be-4470-9f91-99d6de102f53 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:01.201682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:01.202538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:01.202814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:01.203083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:01.223186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:01.225592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.233733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:01.234512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:01.234786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:01.235058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:01.236247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:01.237695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.239249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:01.245142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:08:01.247638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:01.249120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:08:01.250047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:08:01.250047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:08:01.250047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:01.250047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:01.256267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:01.312965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:01.328634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:01.347520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ffe07-1144-425d-b1b3-2cd0e1d4f005 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:01.356630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8fd74-9757-4155-8806-9b08abeb8459 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:01.382216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:01.382946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:01.383222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:01.383494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:01.384265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.domain.id=default, user.id=e3e90516d5b04b1aba85684942c89813) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:01.384539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:01.386040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84528b6-a7c0-4112-8097-0cb0ac346769 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.389415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:01.390029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:01.390307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:01.390580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:01.391234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:01.391572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:01.393204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eabcaa-7d24-4f0e-9cb1-bfc6d76ccabf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:01.393319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 17 11:08:01 2022] GET /identity/v3/role_assignments?user.id=e3e90516d5b04b1aba85684942c89813&scope.domain.id=default&role.id=a17fbd5f1a91411583f4436858306f31 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:01.413766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:03.496307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa083-3518-4b11-8ffa-ca9a312464ae None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:03.496839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa083-3518-4b11-8ffa-ca9a312464ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:03.496839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa083-3518-4b11-8ffa-ca9a312464ae None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:03.498175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:03.503847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3086-a4b7-4141-b97d-fa631893c2f4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:03.504746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3086-a4b7-4141-b97d-fa631893c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:03.505234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a3086-a4b7-4141-b97d-fa631893c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:03.533484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3e8a3086-a4b7-4141-b97d-fa631893c2f4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:03.535055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3e8a3086-a4b7-4141-b97d-fa631893c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:03.571995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53244-b0fc-4718-a835-0800a7126c40 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:03.572618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53244-b0fc-4718-a835-0800a7126c40 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:03.573084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df53244-b0fc-4718-a835-0800a7126c40 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:03.574897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:03.593309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1eb38-e4fa-40df-a616-b6406397baa7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:03.593937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1eb38-e4fa-40df-a616-b6406397baa7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:03.594413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1eb38-e4fa-40df-a616-b6406397baa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:03.618957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a3e1eb38-e4fa-40df-a616-b6406397baa7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:03.624237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3e1eb38-e4fa-40df-a616-b6406397baa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:03.661684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:03.725722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:04.050183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feb3e-b3ff-4b1b-8286-05b6aa6c79bd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.050824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feb3e-b3ff-4b1b-8286-05b6aa6c79bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.051338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feb3e-b3ff-4b1b-8286-05b6aa6c79bd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.052925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 12/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:04.058452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107103-4c49-4b2a-a16c-75edc950d431 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.058735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107103-4c49-4b2a-a16c-75edc950d431 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.059006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da107103-4c49-4b2a-a16c-75edc950d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.059783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4feb3e-b3ff-4b1b-8286-05b6aa6c79bd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.088988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da107103-4c49-4b2a-a16c-75edc950d431 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:04.090171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da107103-4c49-4b2a-a16c-75edc950d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:04.146347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:04.214222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:04.215955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96187e-2b57-4a22-823a-9676cc472e1e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.216446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96187e-2b57-4a22-823a-9676cc472e1e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.217063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96187e-2b57-4a22-823a-9676cc472e1e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.218788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 16/28] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:04.219731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96187e-2b57-4a22-823a-9676cc472e1e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.223836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:04.228667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4feb3e-b3ff-4b1b-8286-05b6aa6c79bd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.271847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.272517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.272795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.273069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.295250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fecb3fe5-2ad7-484e-b5ef-b8eeab07c69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:04.302099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:04.302948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:04.303701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 13/29] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:04.311586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.314066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.314346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.348481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:04.349686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:04.427135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 14/30] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:04.428353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.440297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96187e-2b57-4a22-823a-9676cc472e1e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.472112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:04.533163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.534398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.534859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.535281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.540178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cc706-f6ef-407b-9396-cdf7c8955c09 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.546885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:04.548669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:08:04.566339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:04.567389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:08:04.568292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:08:04.568292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:08:04.568292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:04.569934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:04.570871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.579338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.580085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.581293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.581583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.582273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:04.582587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:04.584071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:04.599866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:04.601456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.643456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:04.721280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:04.725590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97d195-31ff-4196-8d6e-60541d973701 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.764642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.765274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.765401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3bd06-3417-4693-a8a5-a6de5ee90944 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.765570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.765825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.766489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:04.767051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:04.768488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:04.781929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:04.782799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.855831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.856450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.856731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.857006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.857846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:04.859359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:04.893960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c2d3e-4332-4777-8bc5-2cad811bcccc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:04.928739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:04.929382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:04.929661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:04.929938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:04.931474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:04.932953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:04.934841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:04 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:04.935471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:04.966000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:05.012908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 17 11:08:04 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:05.014164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:05.048026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935130c7-4f38-4558-9e34-f03cf97b8059 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.094066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:05.094705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.095153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.096434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.097325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:05.099563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7425a-ab2f-4752-b9a2-560070d7166a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:05.179104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131c9-2a9e-4222-92d4-ae98edcf8b37 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.204978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:05.216488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:05.217516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.218113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.218865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.220090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:05.221867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:05.238510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 19/36] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 17 11:08:05 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:05.239797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:05.253750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:08:04 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:05.255373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b727f-c405-4d7e-8bd8-ec15d8c56b2e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.255673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b727f-c405-4d7e-8bd8-ec15d8c56b2e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.256023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b727f-c405-4d7e-8bd8-ec15d8c56b2e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.257272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 19/38] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:05.263116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e723-139e-4aa6-add5-3477c8e22352 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.263572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e723-139e-4aa6-add5-3477c8e22352 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.264065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e723-139e-4aa6-add5-3477c8e22352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.318581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1db8e723-139e-4aa6-add5-3477c8e22352 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:05.320246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1db8e723-139e-4aa6-add5-3477c8e22352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:05.430618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a94a15-c68e-4e81-9318-63986126f024 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.470992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 11:08:05.472707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba08152-7802-44d7-8607-d288e6a5e563 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.473198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba08152-7802-44d7-8607-d288e6a5e563 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.473655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba08152-7802-44d7-8607-d288e6a5e563 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.474846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:05.475530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.475738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 21/40] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:05.475839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.476151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.477429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:05.478902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:05.480874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 20/41] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:05.485400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.485729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.485961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.486896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:05.506226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:05.507425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:05.509620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:05.589822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:05.660105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:05.719201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41da2f-a11b-4b59-b513-d23f1b6fb5b5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.749103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:05.761878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:05.762564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.762868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.763153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] PATH_INFO: `/v3/domains/default/users/e3e90516d5b04b1aba85684942c89813/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.765396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e3e90516d5b04b1aba85684942c89813, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:05.766870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:05.783890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Aug 17 11:08:05 2022] PUT /identity/v3/domains/default/users/e3e90516d5b04b1aba85684942c89813/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:05.857163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:05.874512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f378766-f487-4739-8ffe-823cb241b95d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.910846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:05.911486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:05.911768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:05.912077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:05.912772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:05.914359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:05.930457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:05.944225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 17 11:08:05 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:08:05.978938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fd32-2bd1-4f5d-8f44-64377302ad54 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:05.982460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:06.021791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:06.022455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:06.022725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:06.022995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:06.024179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:06.025678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a91d97-7de5-4110-8528-a5372228d5ba None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:06.027469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:06.033157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:06.142623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5b29b-ce18-42ea-aab1-6b2e5107f731 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:06.175405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:06.176048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:06.176329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:06.176600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:06.177252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:06.178698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9b48-03cc-4ec6-b2dd-f342b6134917 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:06.206478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:08:06 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:08:07.695875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55bb8-d7f6-4680-b856-557d31260622 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:07.696857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55bb8-d7f6-4680-b856-557d31260622 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:07.697156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55bb8-d7f6-4680-b856-557d31260622 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:07.698527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:07.704034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0a9f-2a25-4cd4-a2a5-250ed7925fb4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:07.704464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0a9f-2a25-4cd4-a2a5-250ed7925fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:07.704648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb0a9f-2a25-4cd4-a2a5-250ed7925fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:07.723339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7deb0a9f-2a25-4cd4-a2a5-250ed7925fb4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:07.729605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7deb0a9f-2a25-4cd4-a2a5-250ed7925fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:07.780409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:07.804302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:08.068732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55bb8-d7f6-4680-b856-557d31260622 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.101187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a8c0-7536-4598-a6c4-5c6cdc511382 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.101474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a8c0-7536-4598-a6c4-5c6cdc511382 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.101748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a8c0-7536-4598-a6c4-5c6cdc511382 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.103145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 26/49] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:08.108676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.109022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.109293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.127399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:08.128631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:08.177479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55bb8-d7f6-4680-b856-557d31260622 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.195456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 27/50] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:08.211490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.212154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.212435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.212707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.222970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:08.227762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:08.228862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:08.229661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 24/51] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:08.235095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.331968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aeda5-773e-45b8-8356-95affbe50d7d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.450910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:08.458923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.479716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.480376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.480658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.480934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.481602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:08.481925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.483305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.490790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:08.491620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 28/52] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:08.497192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.560860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57672eb-f4b8-4802-9ee8-f01d5d14addf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.594198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.594743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.595023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.595303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.596468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.597334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bdedf-2177-4a54-a192-5588d0e5ab97 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.597941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.599545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 25/53] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:08.605073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.632086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.632719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.632986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.633260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.634426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.635870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.637648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 29/54] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:08.643261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.686077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:08.702607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:08.705744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a2c3b-f9a0-4115-81da-780bf0bb8ad6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.739390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.740105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.740387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.740659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.741303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.742749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.746999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecb6d-a394-4bbd-aeaa-7001ed73ebc7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.771833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 26/55] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 17 11:08:08 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:08:08.782363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.783031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.783317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.783611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.784841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.786335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7cb0b-9dca-44ff-9a3e-aaa827ea5d31 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.788044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 30/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:08.794302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:08.900557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e79-6b61-4167-8e49-3cb68e13d2f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:08.937063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:08.937692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:08.937974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:08.938256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:08.938987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.domain.id=default, user.id=e3e90516d5b04b1aba85684942c89813) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:08.939319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:08.940843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f458c15-f529-4ba8-a195-b89d5e01b155 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:08.946881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 27/57] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 17 11:08:08 2022] GET /identity/v3/role_assignments?user.id=e3e90516d5b04b1aba85684942c89813&scope.domain.id=default&role.id=a17fbd5f1a91411583f4436858306f31 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:10.668850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557dae-9232-4734-b60d-25a57ed3202f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:10.669391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557dae-9232-4734-b60d-25a57ed3202f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:10.669391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d557dae-9232-4734-b60d-25a57ed3202f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:10.670926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 31/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:10.677697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:10.678391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:10.678631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:10.702096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:10.703655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:10.716178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:10.774928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 28/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:11.047959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d557dae-9232-4734-b60d-25a57ed3202f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:11.165786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d557dae-9232-4734-b60d-25a57ed3202f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:11.174811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:11.199274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:11.199891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:11.200201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:11.200470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:11.201770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:11.203214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f599e-5f5d-4292-9ecc-bc2d17240d0a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:11.204795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 32/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:11.211072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:11.325242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b077873-1bbc-457f-b05d-d3d579b02dc3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:11.372397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:11.373415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:11.373831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:11.374317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:11.375364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:11.377775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc58da8-d8b3-4c69-a2e3-574a29286c1f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:11.412406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 29/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:11 2022] POST /identity/v3/users => generated 275 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:14.403494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde526d-de7d-4ad7-afed-90a3b7ec1aa2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.404671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde526d-de7d-4ad7-afed-90a3b7ec1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.404871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde526d-de7d-4ad7-afed-90a3b7ec1aa2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.406403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:14.411549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a538aa-8a5a-477c-97f6-baff1b6a2b16 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.412318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a538aa-8a5a-477c-97f6-baff1b6a2b16 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.412750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a538aa-8a5a-477c-97f6-baff1b6a2b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.424400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:14.442219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-78a538aa-8a5a-477c-97f6-baff1b6a2b16 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:14.443614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-78a538aa-8a5a-477c-97f6-baff1b6a2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:14.531663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 30/63] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:14.665498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4e68-154c-46d8-80c6-45e04f99b10d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.665685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4e68-154c-46d8-80c6-45e04f99b10d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.665954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4e68-154c-46d8-80c6-45e04f99b10d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.667456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 34/64] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:14.673319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.673792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.674505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.698249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:14.699665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:14.729198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490a66d-d999-4ac5-88f2-6dc7c33f3abe None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.729521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490a66d-d999-4ac5-88f2-6dc7c33f3abe None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.729753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490a66d-d999-4ac5-88f2-6dc7c33f3abe None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.731310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 35/65] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:14.736766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e3bd-59bd-40e3-9995-eff0d6ca99bf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.737006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e3bd-59bd-40e3-9995-eff0d6ca99bf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.739814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e3bd-59bd-40e3-9995-eff0d6ca99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.758399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7b90e3bd-59bd-40e3-9995-eff0d6ca99bf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:14.760067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b90e3bd-59bd-40e3-9995-eff0d6ca99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:14.804410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 31/66] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:14.858121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 36/67] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:14.932906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:14.963129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d14532-2eca-4bfb-a1a9-44223726e583 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.963770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d14532-2eca-4bfb-a1a9-44223726e583 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.964271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d14532-2eca-4bfb-a1a9-44223726e583 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.965877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 37/68] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:14.971416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeec24-1e75-4e38-a6c5-9368765d719f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:14.971963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeec24-1e75-4e38-a6c5-9368765d719f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:14.972443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeec24-1e75-4e38-a6c5-9368765d719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:14.997454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-91eeec24-1e75-4e38-a6c5-9368765d719f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:14.998643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-91eeec24-1e75-4e38-a6c5-9368765d719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:15.031136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.100531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d128a-365e-4b55-b316-ffdb289bf67b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.111731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 38/69] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:15.113219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958775-fe42-431e-9137-b2722467c48a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.113503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958775-fe42-431e-9137-b2722467c48a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.113783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba958775-fe42-431e-9137-b2722467c48a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.119423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 39/70] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:15.121086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.121368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.121641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.140475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:15.141921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:15.151594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.152279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.152562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.152894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.164391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:15.169130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:15.170370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:15.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 32/71] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:15.172103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.216425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.229368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 40/72] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:15.231057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.283806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a57a8-0429-4141-948c-c5438743c149 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.308264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.327164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.327850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.328130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.328403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.339623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:15.345184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:15.346040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:15.346786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 33/73] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:15.347408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.361065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766911-589d-47ca-bd16-5fdf2d198aa5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.415276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.415276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.415276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.415276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.416111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:15.416111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.417734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.426604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 41/74] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.427310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.462010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.467602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abc1e-e26c-464b-82d4-1353d8e8540d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.503690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.504384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.504664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.505612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.516011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:15.520734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:15.521604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:15.522354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 34/75] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:15.522967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.540249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782e40a-f8fb-4aaf-821f-fa833e53c92a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.567046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.574133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.574750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.575027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.575302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.576575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:15.576886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.578330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.586370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 42/76] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.588859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.625986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee598d7-ced0-46c5-b884-71c9e930fcf4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.663350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.664012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.664322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.664578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.678675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.679211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.680320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.682081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 35/77] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.682865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.692574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf573c-57b2-4aeb-94b8-93b397e07a31 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.728754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.729448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.729741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.730022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.731552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.733115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.739092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 43/78] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.739092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.785409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.788685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bedf85-62ca-47c3-97fd-e8cf7103aeac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.823235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.823841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.824136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.824406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.825068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:15.825369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.826826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.834781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 36/79] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.835553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.835930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2d8d7-c545-4528-abe7-f5f049e253ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.871044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.871670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.871975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.872248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.882249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:15.887333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:15.888516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:15.889275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 44/80] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:15.890291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.907856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:15.935795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f407c3-0c10-4bdd-a794-b3dc82516718 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:15.969041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:15.969672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:15.969955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:15.970204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:15.971380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:15.972879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:15.974475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 37/81] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:15.977274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:15.988213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393b480-7ab5-49ed-934a-6c432a9fa91f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.007448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.023625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.024273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.024556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.024832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.077586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61a9d-8851-42c8-801c-a9287bd39d9e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.090631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.092203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.110307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.110846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.111486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.111749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.112172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.112907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.114365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.134551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 38/82] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:15 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:16.135374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.206770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 45/83] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:16.206770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.253930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.272834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1acd-7adf-4f59-9399-910bafcb59d3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.315363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.315693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904dead-faff-4fde-9e9d-703e4a2f99ea None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.316161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.316448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.316726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.318908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.320552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.322201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 39/84] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:16.322979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.335378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.359870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.360967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.360967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.361130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.361804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:16.362102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.363494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.378010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 46/85] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:16.378010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.448884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e8d4-f0db-410f-90fd-f3526a85646e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.493015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.494311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.494729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.495241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.508325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb62c-2f2a-4942-9b4d-d5267ae9b666 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.526449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.555260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.555909 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.556225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.557025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.558370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.560777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.563167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 47/86] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:16.563718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.585663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.587211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.624376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.696014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281a66c-1861-460e-9407-f31e3e2cf29c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.703311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 40/87] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:16.704179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.740834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.742331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.742810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.743548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.777728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.824816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff63e-67e7-4f52-80ef-9f6b9bbe98bc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.831550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.833500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.860495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:16.861086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:16.861363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:16.861637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:16.862936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:16.864540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:16.866214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 41/88] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:16.870871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.892302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:16.947635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 48/89] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:16.948968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:16.973367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674f6f5-ace0-4ca9-90ad-79b6e69618c9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:16.996985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:17.009411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.010029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.010330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.010832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.011403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:17.011711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.013410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.019343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 42/90] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.020154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.059785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cb04e-8ed9-4559-83d7-87a4c8228770 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.097320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.098404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.098877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.099360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.100747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.102450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.108088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 49/91] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:16 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.109572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.130980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235f343-5e8d-403e-b8c4-5df5778db038 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.133299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:17.170059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.170684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.170961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.171234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.232418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:17.234489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caff96b-274a-404f-aebd-dfefb06d19b4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.246238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.247886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.274670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.275778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.276288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.276834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.278642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.280607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.282819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 50/92] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.283960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.359195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 43/93] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:17.359195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.380472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:17.402182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba49bb-a1e3-44f1-9862-a3dbd61759d3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.442417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.443199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.443568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.443954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.444794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=e3e90516d5b04b1aba85684942c89813) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:17.445200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.446739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.456174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 51/94] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/role_assignments?user.id=e3e90516d5b04b1aba85684942c89813&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.457221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.457743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:17.471369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864e09-a76c-4f40-8d2b-bbba45b06a93 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.510477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21b894-7183-45c4-b261-3b925790911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.511104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21b894-7183-45c4-b261-3b925790911e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.511374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21b894-7183-45c4-b261-3b925790911e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.511652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21b894-7183-45c4-b261-3b925790911e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.512509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21b894-7183-45c4-b261-3b925790911e None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:17.512921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21b894-7183-45c4-b261-3b925790911e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.514540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21b894-7183-45c4-b261-3b925790911e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.520995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 44/95] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=558419835357498886a96d0af76609b8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.574983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232b98-fb52-445b-831b-53c2d86f7c7c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.615198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.615765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.616082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.616356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] PATH_INFO: `/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.617545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] RBAC: Authorizing `identity:get_project(project_id=0676e76adbaa422bafb2b032ae0b7a3e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.619057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e8624-1129-414b-b0ef-e315c77ed100 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.621172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 52/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:17.627902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21b894-7183-45c4-b261-3b925790911e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:17.746179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21b894-7183-45c4-b261-3b925790911e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:17.788383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:17.789005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:17.789283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:17.789556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:17.790290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=0676e76adbaa422bafb2b032ae0b7a3e, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:17.790595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:17.792066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4192b-2c4b-4d43-93b5-4c8c8e548fac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:17.797745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 45/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:17 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=0676e76adbaa422bafb2b032ae0b7a3e&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:18.552606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78774aab-7fc0-43d9-883d-6eee35fbedc8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:18.552886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78774aab-7fc0-43d9-883d-6eee35fbedc8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:18.553406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78774aab-7fc0-43d9-883d-6eee35fbedc8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:18.555187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 53/98] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:18.565833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7806-1c2b-4f03-8ced-49184354bfce None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:18.566319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7806-1c2b-4f03-8ced-49184354bfce None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:18.566485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f7806-1c2b-4f03-8ced-49184354bfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:18.592915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-df3f7806-1c2b-4f03-8ced-49184354bfce None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:18.594135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df3f7806-1c2b-4f03-8ced-49184354bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:18.604147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:18.690361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 46/99] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:18.972067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f692-e600-4c9e-ad6f-cc18fc2b97f5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:18.973074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f692-e600-4c9e-ad6f-cc18fc2b97f5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:18.973545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f692-e600-4c9e-ad6f-cc18fc2b97f5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:18.975108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 54/100] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:18.980351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:18.980643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:18.980923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:18.999442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:19.004684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:19.093512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 47/101] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:19.228358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f692-e600-4c9e-ad6f-cc18fc2b97f5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:19.251945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:19.351820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f692-e600-4c9e-ad6f-cc18fc2b97f5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:19.393032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:19.394083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:19.394556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:19.395046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:19.396486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:19.398174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:19.400061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 55/102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:19.407947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:19.528506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:19.539624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:19.561737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c3a33-2083-4ad4-8c60-624e8df756c7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:19.672675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:19.673305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:19.673954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:19.674176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:19.674849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:19.676359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:19.698571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0b8e-2119-469c-bd15-cc526e19b753 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:19.700328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:19.759389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:19.760073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:19.760358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:19.760637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:19.770195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 48/103] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:08:19 2022] POST /identity/v3/projects => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:19.777582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:19.784246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:19.785125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:19.785891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 56/104] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:19.793044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:19.946635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e806a7d-f350-48ea-bd49-4fd85c0f06d1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:19.977604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:19.994149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:19.994792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:19.995071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:19.995340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:19.996067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:19.996371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:19.998047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb780a0-c355-481e-91a3-374f71f7455a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:20.007508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 49/105] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:20.017089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.038555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096426cb-2e18-434f-810d-db0afff86afc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.038833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096426cb-2e18-434f-810d-db0afff86afc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.039008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096426cb-2e18-434f-810d-db0afff86afc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.040770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 50/106] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:20.054366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fdee-9d6f-4dac-b969-7b997ef2a4a7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.054666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fdee-9d6f-4dac-b969-7b997ef2a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.054917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fdee-9d6f-4dac-b969-7b997ef2a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.079664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6fa2fdee-9d6f-4dac-b969-7b997ef2a4a7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:20.083631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6fa2fdee-9d6f-4dac-b969-7b997ef2a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:20.144895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a978556-6cb6-41a3-9897-6f40c8c0a9e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:20.154560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 51/107] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:20.155851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd99f-f32f-435d-b9b1-7871fa5ff035 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.156178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd99f-f32f-435d-b9b1-7871fa5ff035 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.156456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fd99f-f32f-435d-b9b1-7871fa5ff035 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.157703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 52/108] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:20.162965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.163249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.163525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.182190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:20.182980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:20.183087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.183273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.183552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] PATH_INFO: `/v3/users/33f6577f3bab45cea62ac0b9aa5622f0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.184372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:20.199672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] RBAC: Authorizing `identity:get_user(user_id=33f6577f3bab45cea62ac0b9aa5622f0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:20.201267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:20.204096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 57/109] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/users/33f6577f3bab45cea62ac0b9aa5622f0 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:20.208836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.213372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:20.257290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 53/110] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:20.323661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584b9bc-c14f-49bd-bf02-cd9a5a9b116b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:20.359152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:20.359779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.360099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.360378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.431945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:20.434341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce065b87-36d6-4357-a7ae-2b9415f09a3b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:20.437260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:20.537557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 58/111] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:20.543454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.601469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:20.629659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d978d3-c836-4565-8cc8-84c5412acb70 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.630279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d978d3-c836-4565-8cc8-84c5412acb70 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.630748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d978d3-c836-4565-8cc8-84c5412acb70 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.632494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 59/112] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:20.638621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.639653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.640183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.663403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901f330-a86e-43cc-8fbb-80989b36ae99 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:20.676948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:20.678151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:20.703395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:20.704662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.704944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.705219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.707161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:20.708699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:20.715178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 54/113] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:20.715178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.772873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 60/114] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:20.774379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.811188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:20.884363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724449c4-6612-4755-876e-d7b230a341a8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:20.886497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea5174-17e1-4508-92d9-2e3e2fefd77e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:20.912691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:20.929440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:20.930083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:20.930466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.930879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.931011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.931381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.931534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.931843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.943341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:20.945109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:20.948810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:20.949820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:20.951449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:20.952924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 55/115] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:20.953798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fa7f13cd-aa33-45c5-8950-d611e9385b11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:20.954196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:20.955011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:20.955766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:20.958280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 61/116] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:20.967325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2f2f-49d6-41dd-b0b4-2e0bc56f29ec None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:20.967810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2f2f-49d6-41dd-b0b4-2e0bc56f29ec None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:20.968721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f2f2f-49d6-41dd-b0b4-2e0bc56f29ec None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:20.970494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 62/117] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:20.971633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2f2f-49d6-41dd-b0b4-2e0bc56f29ec None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.063312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc23e5-598d-4b38-8a68-388d882e3dfa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.097715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.100434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.101155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.101440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.101720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.102550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=33f6577f3bab45cea62ac0b9aa5622f0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:21.102861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.104353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.108581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f2f2f-49d6-41dd-b0b4-2e0bc56f29ec None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.109883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 56/118] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/role_assignments?user.id=33f6577f3bab45cea62ac0b9aa5622f0&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=16f03782a3904012a7f528350fb4c78c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.112804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.149836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.150376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.150654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.150926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.151708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:21.152046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.154321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301453ce-246f-467d-b7ad-e68bcd4642e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.164181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 63/119] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.164181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.164181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.164181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.174238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.189770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:21.191626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:21.240512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239650da-d94a-4eb3-a770-00349ea4db69 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.267272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 64/120] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:21.268612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.276862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.277819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.277819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.278134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.278914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:21.279332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.280866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.289847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 57/121] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.295184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.366104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.382897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c26429-2b80-403b-8b5f-71de769926d4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.420329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1b8da-5a2a-4409-809b-c0680bd85d0f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.421283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.423766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.424536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.425136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.425556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.456915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:21.463155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:21.464191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:21.464960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:21.468772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.469700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.470170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.470663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.471790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 65/122] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:21.472348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.472745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.474432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.476643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 58/123] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.477767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.635954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbe10-440e-4541-835e-3c2c48591838 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.647451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5868605-3bab-4df5-aabd-c00322168b52 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.688277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.688764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.688899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.689082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.689423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.690109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:21.690211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.690411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.690859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.691386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.692009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.693013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.694679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.696555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 66/124] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.702041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 59/125] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.702637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.702967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.719823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.744158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.826175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577aae2-109f-4183-9e1f-c7c469afc5bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.838539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2daf-133d-482e-bf02-4fab92b649b1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:21.863351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.864425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.864995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.865568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.866906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:21.868807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:21.870800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 67/126] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:21.871822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.883131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:21.884167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:21.884646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:21.885143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:21.898360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:21.905232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:21.906113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:21.906892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:21.909259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 60/127] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:21.910330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:21.970331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:21.992897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc083e2c-2bd1-4989-a00b-0409b5099c37 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.013989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.022788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c6e8-6385-49cb-bac3-dc9005710e1e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.032710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.034020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.034463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.034890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.036302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.038020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.039996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 68/128] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.041026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.065902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.067108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.067542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.067975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.069225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.070774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.072862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 61/129] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:21 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.073723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.158694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daaffc-2304-45a8-8f2f-4b0cb7695e6a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.184045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a219b8-58b9-4a87-940b-2f311d887710 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.202090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.203461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.203962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.204426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/d193d288f745403fa4e799d290b507cb/roles/558419835357498886a96d0af76609b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.207580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, user_id=d193d288f745403fa4e799d290b507cb, role_id=558419835357498886a96d0af76609b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.210237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.223806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.224613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.224892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.225155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.226030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:22.226329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.227809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.229605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 69/130] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:22 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/d193d288f745403fa4e799d290b507cb/roles/558419835357498886a96d0af76609b8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:22.231034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.238976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 62/131] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.239979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.246511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.272609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.365837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af02d0-8921-46aa-9e60-cc3969a42f3e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.373078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e654cf-a7b7-4e13-b530-3d0f650d0944 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.412676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.414271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.414742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.415199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.416665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.419138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.421439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 63/132] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:22 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.422524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.441171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.441876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.442517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.442517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/d193d288f745403fa4e799d290b507cb/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.445383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, user_id=d193d288f745403fa4e799d290b507cb, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.447450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b6839-eaf1-4d50-8df7-89c8daa547f6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.466311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 70/133] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:22 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/d193d288f745403fa4e799d290b507cb/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:22.468687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9efe5-1cb5-42fa-adec-a23a78699bc3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.468981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9efe5-1cb5-42fa-adec-a23a78699bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.469260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9efe5-1cb5-42fa-adec-a23a78699bc3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.471315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 71/134] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:22.472357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9efe5-1cb5-42fa-adec-a23a78699bc3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.542787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.555738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6426683-1d01-41c6-9371-9ec514bb7ddb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.561070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.595116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.596225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.596768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.597241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.598844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.600348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9efe5-1cb5-42fa-adec-a23a78699bc3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.601008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b2c02-0ecc-44b8-9ac1-0c816adc3596 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.602975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 64/135] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:22 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.605621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.606154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.606716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.644953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:22.646151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:22.649705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.650396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.650673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.651129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/e3e90516d5b04b1aba85684942c89813/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.654248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, user_id=e3e90516d5b04b1aba85684942c89813, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.655719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.679419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 72/136] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:22 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/e3e90516d5b04b1aba85684942c89813/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:22.681646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:22.750250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 65/137] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:22.864726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc98bb1-b93b-46d8-ae6a-987589343685 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:22.907659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:22.915749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:22.917004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:22.917609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:22.917886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] PATH_INFO: `/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:22.919296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=0676e76adbaa422bafb2b032ae0b7a3e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:22.920914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:22.923347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 73/138] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:22 2022] GET /identity/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:22.929464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:23.043222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:23.057595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844dbdd-d566-4e5b-9f06-f41b20311156 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:23.098356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:23.099034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:23.099321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:23.099598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] PATH_INFO: `/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e/users/d193d288f745403fa4e799d290b507cb/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:23.105193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] RBAC: Authorizing `identity:create_grant(project_id=0676e76adbaa422bafb2b032ae0b7a3e, user_id=d193d288f745403fa4e799d290b507cb, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:23.106888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:23.124896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 66/139] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:22 2022] PUT /identity/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e/users/d193d288f745403fa4e799d290b507cb/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:23.172633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:23.317788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d84e6-d472-4874-8d89-687a5df4d1f1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:23.358489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:23.359486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:23.359988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:23.360481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:23.361814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:23.363462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70069719-e141-4036-adfd-f2acff59d6e8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:23.365257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 74/140] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:23.371127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:23.441470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a143-6b92-473d-9b54-57e36fc58614 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:23.442103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a143-6b92-473d-9b54-57e36fc58614 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:23.442572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99a143-6b92-473d-9b54-57e36fc58614 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:23.444217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 75/141] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:23.449734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:23.450361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:23.451113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:23.474602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:23.476195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:23.531633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264e932-5e0b-4d4b-af39-fccedeb46829 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:23.570215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:23.583722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 76/142] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:23.616949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:23.617586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:23.617871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:23.618152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:23.618831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:23.620339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:23.655678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 67/143] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:23 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:23.963543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:24.083813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b6460-bf04-40bb-ac6e-203346ef5970 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:24.128617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:24.129274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:24.129556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:24.129851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:24.147589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:24.152407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:24.153336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:24.154078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 77/144] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:24.159736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:24.169157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:24.303989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6625-ce85-48a1-ab0e-f401b61b24d8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:24.350981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:24.351525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:24.351813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:24.352117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:24.352816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:24.353121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:24.354515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:24.367785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 68/145] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:24.373444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:24.484288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:24.541760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71f2b4-2012-4921-ab20-0a4460703502 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:24.595169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:24.596129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:24.596583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:24.597037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] PATH_INFO: `/v3/users/33f6577f3bab45cea62ac0b9aa5622f0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:24.600052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] RBAC: Authorizing `identity:get_user(user_id=33f6577f3bab45cea62ac0b9aa5622f0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:24.602123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:24.604110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 78/146] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:24 2022] GET /identity/v3/users/33f6577f3bab45cea62ac0b9aa5622f0 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:24.609737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:24.701348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:24.759994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac2a5-6af7-48a5-98d3-e3a4c4c60ab7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:24.797157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:24.797795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:24.798073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:24.798653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:24.799793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:24.801284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a31582-7aa9-417a-8fc5-b95207f22f66 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:24.802897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 69/147] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:24 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:24.808801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:25.015484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a9e9-9e72-4ff3-b2c3-bcab680f26b5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:25.064293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:25.095577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:25.096345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.096629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.096898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/33f6577f3bab45cea62ac0b9aa5622f0/roles/16f03782a3904012a7f528350fb4c78c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.098999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, user_id=33f6577f3bab45cea62ac0b9aa5622f0, role_id=16f03782a3904012a7f528350fb4c78c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:25.100491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd1a47-c16d-40c0-b87c-a74b4c981ce9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:25.126900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 79/148] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:24 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/users/33f6577f3bab45cea62ac0b9aa5622f0/roles/16f03782a3904012a7f528350fb4c78c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:25.230295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50b30-957f-45fd-ac5b-86ddb48a8291 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.230806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50b30-957f-45fd-ac5b-86ddb48a8291 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.230877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e50b30-957f-45fd-ac5b-86ddb48a8291 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.232382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 70/149] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:25.238263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a3cd-c0ca-4236-869a-ed7c79958ebc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.238660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a3cd-c0ca-4236-869a-ed7c79958ebc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.239029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a3cd-c0ca-4236-869a-ed7c79958ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.261237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f8a1a3cd-c0ca-4236-869a-ed7c79958ebc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:25.262689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f8a1a3cd-c0ca-4236-869a-ed7c79958ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:25.345703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 80/150] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:25.513716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2e63-325c-4212-9587-dced64848540 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.514033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2e63-325c-4212-9587-dced64848540 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.514270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2e63-325c-4212-9587-dced64848540 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.515627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 71/151] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:25.521907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.522362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.522460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.542875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:25.544288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:25.625844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 81/152] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:25.797553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856a75-e919-4a1c-8f4b-5a79d76a9928 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.797859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856a75-e919-4a1c-8f4b-5a79d76a9928 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.798101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78856a75-e919-4a1c-8f4b-5a79d76a9928 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.800060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 72/153] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:25.802488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:25.816713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:25.816987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:25.817419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:25.841350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:25.843597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:25.888316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:25.972903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 73/154] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:25.988326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98633f-0288-48ec-9a09-aacbebe95599 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.038173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.039053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.039499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.039929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.051769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-19cad118-b575-4938-8c39-42be9c1b2e12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:26.056913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:26.058036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:26.059025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:26.064958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 82/155] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:26.067443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.143307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:26.160238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca63d5-abf8-4d69-b1d4-1af9491f6382 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.160671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca63d5-abf8-4d69-b1d4-1af9491f6382 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.161044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca63d5-abf8-4d69-b1d4-1af9491f6382 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.163044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 83/156] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:26.173905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.174470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.174908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.202651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbafdd9-3a0f-4903-adf8-de3f429fbd23 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.205189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:26.207337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:26.264313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.265600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.266686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.267127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.268022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:26.269510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:26.273401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:26.290389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 74/157] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:26.296100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.339354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 84/158] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:26.340848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.415828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:26.493136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d617a4-88bf-40e8-b2aa-13dd7c558426 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.532514 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c78019-1eb8-47ad-81e9-4c116c97d226 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.540145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:26.555559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.556235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.556509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.557342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.576976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:26.584757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:26.585758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:26.586586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 75/159] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:26.589387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.596542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.597235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.597511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.597780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.599293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:26.601769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:26.605194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 85/160] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:26.611998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.777511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810679ba-fbd1-4b09-a76a-ab25ff6de4fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.785752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:26.789023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00097df-55e3-436c-a000-93d5d2915316 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:26.836419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.836760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:26.837028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.837363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.837633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.838177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:26.838357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:26.838649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:26.838999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:26.839454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:26.840052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:26.850890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 86/161] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:26.850890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.860812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:26.866856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:26.867792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:26.868914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 76/162] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:26.877047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:26.970186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:27.003908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf571d-7032-4bba-a8f3-f86b645f36a7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.053924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.054543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.054816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.055086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.098695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac717c9-967b-457f-8819-5f898a42dcbb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.107437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:27.164657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:27.166137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:27.178878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.179526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.179801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.180096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.203429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:27.209603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:27.210673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 77/163] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:27.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:27.307002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 87/164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:27.307790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:27.396311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:27.457190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf29e7-f68d-4d27-9d03-1c0e9836f2fa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.459831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fbcc7-76c0-40b7-8be6-f148bca511e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.472974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:27.522301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.522923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.523198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.523463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.524163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:27.524462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:27.525837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:27.541502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 88/165] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:27.542218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:27.552618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.553638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.554118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.554586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.556008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:27.557792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:27.559795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 78/166] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:27.561932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:27.697836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005886-c7d9-4d40-aa3c-dcae0d31fb38 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.760291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:27.780633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.781728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.782064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.782335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.783065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:27.783368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:27.784826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:27.799045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 89/167] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:27.799711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:27.838772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef54d-32ed-4da7-8db5-ede4cd6a12ce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:27.937238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:27.937895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:27.938168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:27.938434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:27.939586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:27.941165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:27.942982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 79/168] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:27.943660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.003844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fdd81-ef76-4553-82af-97db18fe7f37 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.021517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.066943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.067593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.067872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.068170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] PATH_INFO: `/v3/users/e3e90516d5b04b1aba85684942c89813` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.070472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e90516d5b04b1aba85684942c89813)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.071952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.074646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 90/169] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/users/e3e90516d5b04b1aba85684942c89813 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:28.078377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.100944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022313ae-6d79-4d23-8fd9-f66cac9897cf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.156676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48690-18be-4b95-b460-89d50319249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.157300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48690-18be-4b95-b460-89d50319249f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.157576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48690-18be-4b95-b460-89d50319249f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.157847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b48690-18be-4b95-b460-89d50319249f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.194440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.253791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1083e-ae01-423c-a444-8aeb22c33f43 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.287901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.288567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.288845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.289121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] PATH_INFO: `/v3/users/d193d288f745403fa4e799d290b507cb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.290258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] RBAC: Authorizing `identity:get_user(user_id=d193d288f745403fa4e799d290b507cb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.291786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.293984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 91/170] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/users/d193d288f745403fa4e799d290b507cb => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:28.294814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.318008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b48690-18be-4b95-b460-89d50319249f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.319501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b48690-18be-4b95-b460-89d50319249f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.396649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb9c5-5d53-4e1a-abcc-2fe741314d15 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.420676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.423796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.433542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.434185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.434470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.434736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.435504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:28.435900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.437296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe2cb-15b0-419e-9d5b-47fb8b1bfd4a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.443500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 92/171] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=558419835357498886a96d0af76609b8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:28.450385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f60c3-d507-48f2-9837-e0710d6e7553 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.451036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f60c3-d507-48f2-9837-e0710d6e7553 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.451468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f60c3-d507-48f2-9837-e0710d6e7553 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.454432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 93/172] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:28.460617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f60c3-d507-48f2-9837-e0710d6e7553 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.501333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 80/173] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:28.506839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48690-18be-4b95-b460-89d50319249f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.592546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f60c3-d507-48f2-9837-e0710d6e7553 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.631590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b48690-18be-4b95-b460-89d50319249f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:28.633820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.634447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.634726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.634996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.673436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:28.673969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.674243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.674511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.686595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.693901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.707193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.708686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc302ad-55ea-44da-a335-8d84c5ee88e8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.748000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:28.749501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:28.806305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 94/174] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:28.807905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7f85-4901-4b9f-a60d-1a8c1990a478 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.808222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7f85-4901-4b9f-a60d-1a8c1990a478 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.808493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7f85-4901-4b9f-a60d-1a8c1990a478 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.809950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 95/175] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:28.810956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b988-c75c-4653-91e7-bdb6e4fb9008 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.811230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b988-c75c-4653-91e7-bdb6e4fb9008 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.811639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b988-c75c-4653-91e7-bdb6e4fb9008 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.812962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 96/176] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:28.813963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cc22-d63e-4e94-a652-d6719b6b57e3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.814240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cc22-d63e-4e94-a652-d6719b6b57e3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.814511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cc22-d63e-4e94-a652-d6719b6b57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.832635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b7f1cc22-d63e-4e94-a652-d6719b6b57e3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:28.833828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7f1cc22-d63e-4e94-a652-d6719b6b57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:28.849916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 81/177] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:28.852828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.896972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 97/178] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:28.901532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d615-fefe-49f0-b48d-35f914d50fc2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:28.901847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d615-fefe-49f0-b48d-35f914d50fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:28.902120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d615-fefe-49f0-b48d-35f914d50fc2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:28.903415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 98/179] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:28.907436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d615-fefe-49f0-b48d-35f914d50fc2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:28.922946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:28.968934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc006047-34d1-4678-87d9-e187ac4b6502 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.007017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.007789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.008280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.008403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.009468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.010925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63d7f-a400-439e-890c-54dba9d405ba None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.011752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d615-fefe-49f0-b48d-35f914d50fc2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.017671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 82/180] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.017671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.017671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.017671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.032825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:29.034068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:29.052090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.052724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.053007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.053273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.054389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.055824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e5258-ec8a-4f37-ac37-b42a1c11e7ec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.057646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 99/181] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:28 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.058725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054792-506e-4d94-92b7-76643c6d9767 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.059060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054792-506e-4d94-92b7-76643c6d9767 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.059302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63054792-506e-4d94-92b7-76643c6d9767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.077206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-63054792-506e-4d94-92b7-76643c6d9767 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:29.078379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-63054792-506e-4d94-92b7-76643c6d9767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:29.107443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 83/182] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:29.108566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.155559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 100/183] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:29.156904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.157184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.157452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.161165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.177331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:29.178816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:29.188465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.229856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad9da-5dcb-4431-89a0-a764b85b51de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.246541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 101/184] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:29.247434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.284177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.284813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.285088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.285377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] PATH_INFO: `/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.286464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] RBAC: Authorizing `identity:get_project(project_id=0676e76adbaa422bafb2b032ae0b7a3e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.288040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.289780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 84/185] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/projects/0676e76adbaa422bafb2b032ae0b7a3e => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.290690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.348087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27973fe-2997-42c7-a1b9-d85c5a995c63 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.384111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.384991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.385265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.385804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.386991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:29.387626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.389038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.397333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 102/186] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.398207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.413161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.446001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105603-e1de-4cff-9d7b-938563c6cef1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.462593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.500030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.501558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.502728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.503197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.504473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=e3e90516d5b04b1aba85684942c89813) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:29.505374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.507094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.517510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 85/187] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/role_assignments?user.id=e3e90516d5b04b1aba85684942c89813&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.518906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.529685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84fee3-82cf-405a-907e-4f97062bc108 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.584214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.585334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.585822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.586282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.599550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:29.606415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:29.607359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:29.608209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:29.610802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 103/188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:29.612992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.676817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c15-ac7e-4e3e-9262-63983ebcdaf1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.691411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.721611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.722517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.722796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.723073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.723822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=0676e76adbaa422bafb2b032ae0b7a3e, user.id=d193d288f745403fa4e799d290b507cb) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:29.728005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.729744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.732625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eeb17-8d31-4cf0-9114-b75a11f0a968 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.738561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 86/189] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/role_assignments?user.id=d193d288f745403fa4e799d290b507cb&scope.project.id=0676e76adbaa422bafb2b032ae0b7a3e&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.739707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.789870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.790580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.790917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.791254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.791360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.804921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:29.811511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:29.812616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:29.813381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:29.817277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 104/190] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:29.818913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.878539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b67fc-733d-4983-9d42-a9a6c2058255 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.922608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.924805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.924805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.924805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.935964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:29.936116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9fc7-7e62-42bc-85cb-a1cee34c6f3d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:29.941139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:29.942015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:29.942787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:29.947055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 87/191] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:29.947055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:29.967435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:29.976532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:29.977221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:29.977566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:29.977964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:29.978560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:29.978859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:29.980274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:29.990791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 105/192] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:29.991599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.048362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.054533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869ed45-4f73-4139-93ee-f4b2b818a5ea None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.088998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.089616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.089912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.090543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.091630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c155a-0582-4260-a22a-1304487083fd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.091773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.093153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.094686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 88/193] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.096623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.127236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465942-3a98-4662-828e-e3730363764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.127843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465942-3a98-4662-828e-e3730363764c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.128141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465942-3a98-4662-828e-e3730363764c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.128408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60465942-3a98-4662-828e-e3730363764c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.129063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465942-3a98-4662-828e-e3730363764c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:30.129359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465942-3a98-4662-828e-e3730363764c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.130737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60465942-3a98-4662-828e-e3730363764c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.138807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 106/194] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.139588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465942-3a98-4662-828e-e3730363764c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.190219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.202568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3c5e6-3ef5-463b-9fa8-1c1a2b11fab5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.237302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60465942-3a98-4662-828e-e3730363764c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.238735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.239354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.239637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.239910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.240610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:30.240911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.242325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.250457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 89/195] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.251229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.276725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.277353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.277547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.277702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.278156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.291493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.292979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.294872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 107/196] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.295627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.349674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146909-e43c-4f80-b215-80e62c765f37 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.385440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.386043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.386317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.386587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.387246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.388722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.396806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ba353-740d-482e-ad07-bb54f03199c7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.408139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.410193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 90/197] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:30 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:30.411325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.447510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.448187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.448458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.448728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] PATH_INFO: `/v3/users/33f6577f3bab45cea62ac0b9aa5622f0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.449993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] RBAC: Authorizing `identity:get_user(user_id=33f6577f3bab45cea62ac0b9aa5622f0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.451468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.458148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 108/198] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/users/33f6577f3bab45cea62ac0b9aa5622f0 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.458148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.509958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.532925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552164-bd10-44cd-abde-fba1989e9c17 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.570396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9238-c505-4f6c-81d6-70d74cb5b9bf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.579833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.580615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.581014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.581365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.582682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.584796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.586705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 91/199] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:30.587251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.621186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.621999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.623264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.623264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.683533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.716731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.718229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.760276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b810-868f-478d-80dd-b4ff2a1e0bf9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:30.815540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:30.816576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:30.817031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:30.817488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:30.843268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.864704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 109/200] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:30.866192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:30.911138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:30.912994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:30.972610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:30.997551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b13e0d5-3648-4d56-8793-3a5a5bc08fe9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.019334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 92/201] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:31.020531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.035407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.036822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.037534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.037992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.074662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:31.125967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.127470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.140230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c457ad-becb-49ec-a983-cd79ae0f278d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.183035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.183622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.183951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.184235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.185907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.187641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.190392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 93/202] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:31.192686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.218450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:31.248279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 110/203] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:31.249947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.312245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2443f-3166-4ff1-bd77-a658cf83b4d5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.332162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:31.352374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.353364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.353899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.354351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.356117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.357831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.360113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 94/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:31.361103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.386346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db101-605f-4bd0-a205-a0046e031b5c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.430040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.430648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.430923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.431189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.431934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=f75f489d93764999a40ee7bcb901df21) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:31.432240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.434739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.441729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 111/205] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/role_assignments?user.id=f75f489d93764999a40ee7bcb901df21&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:31.442363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.477973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7d81-948b-43e7-84d8-8070ef94977a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.502675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:31.546897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.548890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.549684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.550343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.552581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.555546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.564831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 95/206] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:31.567108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:31.604152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1dce0-45b7-46fa-a94e-419e6f15f4f1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.646939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.648463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.650124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.650604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.651759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602, user.id=33f6577f3bab45cea62ac0b9aa5622f0) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:31.652522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.654900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7a377-0415-4743-b032-a5fe0e6dde48 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.664552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 112/207] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/role_assignments?user.id=33f6577f3bab45cea62ac0b9aa5622f0&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=16f03782a3904012a7f528350fb4c78c => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:31.678617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:31.731278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb248d2-7a34-4433-beaa-0cf05cd03059 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:31.768566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:31.769199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:31.769478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:31.769827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:31.770595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=f75f489d93764999a40ee7bcb901df21) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:31.770909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:31.772749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb980d0d-6fad-429e-a0fe-0dcdc67ed8fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:31.779459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 96/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:31 2022] GET /identity/v3/role_assignments?user.id=f75f489d93764999a40ee7bcb901df21&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=558419835357498886a96d0af76609b8 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:32.588977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e1ff2-936c-48cc-a73b-b560e3d9b641 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:32.589701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e1ff2-936c-48cc-a73b-b560e3d9b641 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:32.590410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e1ff2-936c-48cc-a73b-b560e3d9b641 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:32.592077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 113/209] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:32.597636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f28325-dcfe-4006-97e7-3d9104b64fe9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:32.598094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f28325-dcfe-4006-97e7-3d9104b64fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:32.598191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f28325-dcfe-4006-97e7-3d9104b64fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:32.617820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f4f28325-dcfe-4006-97e7-3d9104b64fe9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:32.619040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f4f28325-dcfe-4006-97e7-3d9104b64fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:32.692037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 97/210] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:32.731836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe5f9-5751-4f67-9cf1-2143acd1eea1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:32.732384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe5f9-5751-4f67-9cf1-2143acd1eea1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:32.732384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fe5f9-5751-4f67-9cf1-2143acd1eea1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:32.733886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 114/211] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:32.738945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:32.739231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:32.739509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:32.757484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:32.758648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:32.801148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:32.825751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 98/212] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:32.977275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fe5f9-5751-4f67-9cf1-2143acd1eea1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.081144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fe5f9-5751-4f67-9cf1-2143acd1eea1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.090531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.117533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.118177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.118446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.118720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.120811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.132979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:33.139143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:33.140057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:33.140847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 115/213] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:33.147461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.232313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f68912-f5f6-4c42-951b-66117815a106 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.265880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94dab-d894-4d06-bce1-30fefa7aa665 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.270496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.271133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.271409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.271675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.272802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:33.274265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:33.280817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 99/214] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:33.281676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.303548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c917-cc45-406c-9327-76045027d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.304281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c917-cc45-406c-9327-76045027d47c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.304565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c917-cc45-406c-9327-76045027d47c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.304835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c917-cc45-406c-9327-76045027d47c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.305502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c917-cc45-406c-9327-76045027d47c None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:33.305855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c917-cc45-406c-9327-76045027d47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:33.307383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c917-cc45-406c-9327-76045027d47c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:33.316748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 116/215] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:33.322527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c917-cc45-406c-9327-76045027d47c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.330538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.354789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.385423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3e760-d0fa-4c30-94d8-84fff168afe3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.420012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.420651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.420926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.421192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.421908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:33.423672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab109fa-b288-4c6d-87ee-2688135d639d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:33.433610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c917-cc45-406c-9327-76045027d47c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.456137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 100/216] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:33 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:33.457652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e82de-7553-4ab5-aa6f-7e849cb5fd75 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.457936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e82de-7553-4ab5-aa6f-7e849cb5fd75 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.458211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e82de-7553-4ab5-aa6f-7e849cb5fd75 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.464097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 101/217] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:33.466007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100f6b-82ac-479f-a682-6556aef18a37 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.466281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100f6b-82ac-479f-a682-6556aef18a37 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.466549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100f6b-82ac-479f-a682-6556aef18a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.482121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.483209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.483712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.484212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] PATH_INFO: `/v3/users/8abb6a6698e147cfb6d891396c8ab11b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.487392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da100f6b-82ac-479f-a682-6556aef18a37 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:33.489615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da100f6b-82ac-479f-a682-6556aef18a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:33.502044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] RBAC: Authorizing `identity:get_user(user_id=8abb6a6698e147cfb6d891396c8ab11b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:33.504308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:33.506530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 117/218] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/users/8abb6a6698e147cfb6d891396c8ab11b => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:33.513163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.576087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 102/219] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:33.608506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.626888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82a558-9f72-4d0f-a746-f426bd46755a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:33.662258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:33.663215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.663686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.664204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.742193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:33.743673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:33.834363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf3b-1ff2-4c26-bc64-f212b0df2edf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.835323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf3b-1ff2-4c26-bc64-f212b0df2edf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.835810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885cf3b-1ff2-4c26-bc64-f212b0df2edf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.838836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.839086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 103/220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:33.845339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:33.845903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:33.846370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:33.856665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 118/221] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:33.861598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.875493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:33.876726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:33.909888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:33.982276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 104/222] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:33.983274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:33.991648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdfa79-a6dd-4a38-9619-6a9d51b0cabe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.038008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.038669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.039003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.039276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.062266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:34.073406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:34.074329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:34.075088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:34.075677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 119/223] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:34.081790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.088115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ae86-8ae2-4702-975d-5e3341f94c23 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.123759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.124437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.124715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.125039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.126273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.127729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.129436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 105/224] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:33 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:34.135672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.168372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.173218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.264240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa90d8-5065-4632-8957-d1b5c7fc952f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.272722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbd1ed-594c-48ec-a43b-146f7c8540f6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.306427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.307378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.307744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.308523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.309341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=8abb6a6698e147cfb6d891396c8ab11b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:34.309974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.311516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.313943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.314740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.315209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.315675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.316623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:34.317125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.317793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 106/225] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/role_assignments?user.id=8abb6a6698e147cfb6d891396c8ab11b&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:34.318598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.319096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.329414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 120/226] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:34.335384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.433626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.449119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf0c1-a322-4004-80d8-20fb8686dfdd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.475371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823d4ef-e56e-4f72-ac93-fea86b010833 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.486704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.518264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.519395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.519818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.520259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.522140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.523942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.526036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 121/227] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:34.533140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.539952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.539952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.539952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.539952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.559953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:34.573911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:34.574936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:34.575707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 107/228] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:34.581509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.657346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ff687-eb39-493a-9b60-f5577350536a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.696564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa149e-6289-487a-8e46-8031b3a53c88 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.701981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.702913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.703386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.703847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.708627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.710329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.712538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 122/229] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:34.720193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.739957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.739957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.739957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.739957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.740951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:34.740951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.742291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.752532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 108/230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:34.757046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:34.790063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.813029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:34.911178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497c63-c8ca-4c4b-9e48-a692ed2f7408 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.945731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:34.946818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:34.947189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:34.947549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:34.948982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:34.950609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:34.952928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 109/231] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:34.955488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba1964-ed78-402e-8b8c-952e753b4ac7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:34.958268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:35.023259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:35.023978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:35.024227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:35.024532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/users/f75f489d93764999a40ee7bcb901df21/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:35.026505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, user_id=f75f489d93764999a40ee7bcb901df21, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:35.028766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:35.057503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 123/232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:34 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/users/f75f489d93764999a40ee7bcb901df21/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:08:35.096148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:35.124413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ea9-c7d7-46a0-a384-982a11f005b0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:35.166042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:35.166747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:35.167028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:35.167303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:35.168747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:35.170210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74460a-b18e-4f0c-a4da-54a968901918 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:35.172358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 110/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:34 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:35.178071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:35.323490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889cc4-3682-4e99-ba98-4dec560ba613 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:35.325819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:35.359907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:35.360644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:35.360927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:35.361195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/users/f75f489d93764999a40ee7bcb901df21/roles/558419835357498886a96d0af76609b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:35.363358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, user_id=f75f489d93764999a40ee7bcb901df21, role_id=558419835357498886a96d0af76609b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:35.364837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39fcb0-3bba-4933-8211-36f46fb1c2c2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:35.384662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 124/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:35 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/users/f75f489d93764999a40ee7bcb901df21/roles/558419835357498886a96d0af76609b8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:36.006689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc803c9-cb83-434b-9057-070bf4eb4f20 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.007656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc803c9-cb83-434b-9057-070bf4eb4f20 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.008160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc803c9-cb83-434b-9057-070bf4eb4f20 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.009933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 111/235] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:36.015591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af01df-fa2a-4002-ace1-488381406990 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.016491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af01df-fa2a-4002-ace1-488381406990 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.018387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5eb1f-1fc3-4f98-b509-49d9e3f5195e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.018865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5eb1f-1fc3-4f98-b509-49d9e3f5195e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.019316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5eb1f-1fc3-4f98-b509-49d9e3f5195e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.021029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 112/236] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:36.021234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af01df-fa2a-4002-ace1-488381406990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.025614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.026101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.026572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.045714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:36.047246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:36.057499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-51af01df-fa2a-4002-ace1-488381406990 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:36.059312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51af01df-fa2a-4002-ace1-488381406990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:36.156791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 113/237] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:36.168789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 125/238] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:36.473783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:36.542245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af01df-fa2a-4002-ace1-488381406990 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:36.610402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:36.628768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4c405-f1b4-4918-9070-c0f776a90e54 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:36.722221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:36.723723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.724524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.725231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.727285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:36.736808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36084ba-ef3c-4367-8434-637cd7bd0749 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:36.740802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:36.741723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 114/239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:36.748063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec887b7-1190-4d32-b2d8-17629796d271 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.748852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec887b7-1190-4d32-b2d8-17629796d271 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.749548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec887b7-1190-4d32-b2d8-17629796d271 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.752291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 115/240] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:36.756061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af01df-fa2a-4002-ace1-488381406990 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:36.757749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec887b7-1190-4d32-b2d8-17629796d271 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:36.813516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:36.814893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.815553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.816219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.833744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f0c9dc65-0856-442a-ada5-a0506a5700e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:36.843127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:36.845040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:36.846772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:36.849969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 126/241] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:36.859114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.859806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.860480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.862143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec887b7-1190-4d32-b2d8-17629796d271 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:36.888489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:36.890464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:36.897379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:36.898226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:36.898703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:36.899215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:36.900058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:36.901678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:36.926341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 116/242] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:36 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:36.927420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:36.941833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:37.008753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 127/243] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:37.098745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b7611-ef79-41ec-91f7-de13d6627baa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:37.154341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:37.155207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.155628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.156100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.156920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:37.157362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:37.158893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:37.169217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 117/244] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:37.175229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:37.271152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:37.287899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1eedc2-6b8f-436b-ad58-e77d8a523e90 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:37.326951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:37.327605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.327882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.328199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] PATH_INFO: `/v3/users/fcc896f7fb7b47989a91bcda44a077e6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.343684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=fcc896f7fb7b47989a91bcda44a077e6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:37.345178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:37.347053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 128/245] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:37 2022] GET /identity/v3/users/fcc896f7fb7b47989a91bcda44a077e6 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:37.352543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:37.379777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:37.453115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:37.505061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496226-b5cc-4188-b29d-c5905398a0c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:37.533817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd6733-de2e-4b52-974f-da0d7defb2c0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:37.559172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:37.560264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.560531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.561081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.591094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:37.592159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.592641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.593109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.608043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ef17ce05-0005-432f-ad91-921787d9b92c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:37.613501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:37.614498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:37.615276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:37.617233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 129/246] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:37.619190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7534-fb2a-4c85-b860-26bb08e033af None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.619190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7534-fb2a-4c85-b860-26bb08e033af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.619190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f7534-fb2a-4c85-b860-26bb08e033af None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.620753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 130/247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:37.625980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:37.626319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:37.626590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:37.636607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:37.653349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:37.655011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:37.663584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:37.665438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:37.749360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 131/248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:37.750573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:37.759472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:37.818383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 118/249] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:37.823599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:37.954094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170df8d6-01c4-4940-ad86-f0d1b58e2248 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:37.974934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e914fd-26fa-49b7-9739-cc08a9038260 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.026722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.027664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.028026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.028535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.029268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.030805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.033634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b24302-747e-4702-bf49-6771bc96a2ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.035482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 119/250] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:37 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:38.036864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b560a0-95f0-447b-b880-1a57f6286b92 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.037144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b560a0-95f0-447b-b880-1a57f6286b92 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.037245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.037414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b560a0-95f0-447b-b880-1a57f6286b92 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.037761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.038035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.038304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.038859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 120/251] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:38.038959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:38.039257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.040650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.044415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.044702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.044982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.055625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 132/252] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:38.056504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.066230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:38.067428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:38.102373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.168161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 121/253] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:38.169196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.243657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973d761-88c8-49d7-8b7e-e98c928e7f0a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.297469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e21ff-a6ec-4187-ad57-fc76af5033fa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.311035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.312057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.312525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.313001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.313926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=fcc896f7fb7b47989a91bcda44a077e6) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:38.314438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.316129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.325708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 133/254] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/role_assignments?user.id=fcc896f7fb7b47989a91bcda44a077e6&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=16f03782a3904012a7f528350fb4c78c => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:38.327777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.366095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.367111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.367583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.368072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] PATH_INFO: `/v3/users/8abb6a6698e147cfb6d891396c8ab11b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.369519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] RBAC: Authorizing `identity:get_user(user_id=8abb6a6698e147cfb6d891396c8ab11b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.371288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.373200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 122/255] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/users/8abb6a6698e147cfb6d891396c8ab11b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:38.381161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.449196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.449868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.529199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907fdf1-c3ea-4129-bcad-c3318b52e0f3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.566270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.566916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.567196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.567469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.569015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce331-ea1c-47f3-9aab-72641b4d8e88 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.582830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:38.589047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:38.590126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 134/256] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:38.591056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.630381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.631031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.631302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.631566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.633088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.634542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.636242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 123/257] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:38.637003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.748319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff91db-c91c-4760-a9ae-4ab082d6102d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.776293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.784507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.785541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.785990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.786620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.798850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:38.804112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:38.804957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:38.805728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:38.807839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 135/258] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:38.808797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.922036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7b9bd-951d-4b8b-846a-6891288ab1ca None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.924396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:38.927770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3e5b9-effb-4b28-a4e5-132cec8a05f7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:38.970624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.971237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.971513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.972015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:38.972477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:38.972775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:38.974151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:38.983350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 124/259] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:38.984202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:38.998429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:38.999091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:38.999369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:38.999631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/users/8abb6a6698e147cfb6d891396c8ab11b/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.004258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, user_id=8abb6a6698e147cfb6d891396c8ab11b, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.005714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.026648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 136/260] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:38 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/users/8abb6a6698e147cfb6d891396c8ab11b/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:39.028995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:39.125042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:39.210794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec41b5-751d-4a50-8fcf-656993171fb8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.255861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145997a1-c69b-41ab-a8eb-55c9fa692567 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.298142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.298758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.299030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.299296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.299994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:39.300293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.302748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.318591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 125/261] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:39.324769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:39.333713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.334362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.334633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.334897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.336669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.338353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.340855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 137/262] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:39.348227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:39.373028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:39.515374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1956d0c-07c6-4b6f-86cf-ba67e83dec44 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.550205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985a02-cc40-49a9-a253-1d449fb4ead5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.564146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:39.588527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.589225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.589510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.589775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] PATH_INFO: `/v3/users/f75f489d93764999a40ee7bcb901df21` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.592674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] RBAC: Authorizing `identity:get_user(user_id=f75f489d93764999a40ee7bcb901df21)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.595165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.597934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 126/263] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/users/f75f489d93764999a40ee7bcb901df21 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:39.603248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:39.610754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.611451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.611951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.615887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.698360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.701002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.823042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 138/264] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:39.828432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:39.837542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:39.867723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:39.884681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bf759-9db7-406e-9930-c14ab735eb4b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.946307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6286db-35aa-4260-b607-3e3bd9ac7b8c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:39.970120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.971136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.971611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.972132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.985538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:39.986174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:39.986444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:39.986711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:39.987823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:39.989307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:39.991035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 139/265] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:39.998126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:40.084039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:40.114069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673a6ee-a515-4bb0-8532-6b9d15a0b880 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:40.148996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:40.150746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd22a07-c4c8-453a-8439-137f596fc99e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:40.156263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:40.156876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.157150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.157420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.158268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=f75f489d93764999a40ee7bcb901df21) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:40.158572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:40.160043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:40.166357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 140/266] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/role_assignments?user.id=f75f489d93764999a40ee7bcb901df21&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:40.287463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:40.298478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 127/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:40.301337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:40.317184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3eaee-909a-448d-a3b1-335997847cc9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.317517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3eaee-909a-448d-a3b1-335997847cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.317777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3eaee-909a-448d-a3b1-335997847cc9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.319106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 128/268] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:40.324718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca531-d72b-4cc3-bc7a-9ac91e0e076c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.324990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca531-d72b-4cc3-bc7a-9ac91e0e076c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.325269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca531-d72b-4cc3-bc7a-9ac91e0e076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.351310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-48eca531-d72b-4cc3-bc7a-9ac91e0e076c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:40.352463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48eca531-d72b-4cc3-bc7a-9ac91e0e076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:40.448149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5678-85da-40a1-9322-c5bf6911de89 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:40.490269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 129/269] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:40.491251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:40.491538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb089f-5f7b-45ae-b521-cc9c3d38f3ab None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.491823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb089f-5f7b-45ae-b521-cc9c3d38f3ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.491938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.492120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb089f-5f7b-45ae-b521-cc9c3d38f3ab None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.492214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.492426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.493549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:40.494978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:40.496929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 141/270] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:40 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:40.500406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 130/271] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:40.504939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:40.510102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56480-fb5d-4b8a-bede-38bf9c1071c1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.510432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56480-fb5d-4b8a-bede-38bf9c1071c1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.510703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56480-fb5d-4b8a-bede-38bf9c1071c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.516743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:40.545621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-beb56480-fb5d-4b8a-bede-38bf9c1071c1 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:40.546810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-beb56480-fb5d-4b8a-bede-38bf9c1071c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:40.622180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c91f1-398c-4f0d-8fb8-f62b78e22f81 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:40.661854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:40.662476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.662753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.663025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.663765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=f75f489d93764999a40ee7bcb901df21) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:40.664108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:40.665626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:40.678219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 142/272] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:40 2022] GET /identity/v3/role_assignments?user.id=f75f489d93764999a40ee7bcb901df21&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=558419835357498886a96d0af76609b8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:40.728468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 131/273] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:40.920943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:40.941202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3418-03eb-4ecc-b9c4-b72a833e6535 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.941470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3418-03eb-4ecc-b9c4-b72a833e6535 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.941749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3418-03eb-4ecc-b9c4-b72a833e6535 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.943112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 132/274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:40.948777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:40.948958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:40.949224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:40.971802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:40.973006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:41.008337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.040279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.060989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aea429-26e2-42ee-8e99-bc41386d6fae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.073511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 133/275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:41.095417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.109630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.110274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.110547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.110811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.112628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.114347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.116725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 143/276] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:41.122703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.204045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faaa60-9699-4c01-9cc8-0b1e139775c6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.228444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59aefa-ed4b-4812-9beb-636e78809a73 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.248479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.249489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.249966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.250457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.261872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.262369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:41.262477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.262741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.263002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.263638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.265118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:41.268428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:41.269305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:41.270119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:41.277725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 134/277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:41.279092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.280530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.302489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 144/278] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:08:41 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:08:41.334151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.352659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.394723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b75b60-c03b-4960-b28b-ae38b07031dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.434843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.436081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.437523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.438084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.439054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:41.439538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.441291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.460011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 135/279] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:41.461558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.474123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a767-6e70-42b6-b97d-8d5f4f34d219 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.515779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.516975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.517450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.517893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.530537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:41.535403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:41.536285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:41.537065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 145/280] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:41.542347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.608455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53b3b-59b5-4fbe-a0b3-f607b3bfba48 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.614461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.624415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:41.665588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.666234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.666512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.666790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] PATH_INFO: `/v3/users/615cc07ed65d48c5b4848df936a7d886` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.670454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075fc5b-ca2b-468c-9dd3-54a893aca34b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.685226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] RBAC: Authorizing `identity:get_user(user_id=615cc07ed65d48c5b4848df936a7d886)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.686714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ca35-9fce-4c79-92bf-640a57a9bbc2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.688920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 136/281] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/users/615cc07ed65d48c5b4848df936a7d886 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:41.691442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f576-c188-4654-9daa-96e979ed7717 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.691442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f576-c188-4654-9daa-96e979ed7717 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.691442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315f576-c188-4654-9daa-96e979ed7717 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.692489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 137/282] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:41.694592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315f576-c188-4654-9daa-96e979ed7717 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.717181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.718455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.718999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.719504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.720499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:41.720963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.723134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0cf8-1875-4bd5-87ab-0bcd5eecbc0f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.736001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 146/283] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:41.737486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.737908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.738911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.762298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:41.764000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:41.818378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315f576-c188-4654-9daa-96e979ed7717 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:41.839327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 147/284] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:41.844851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:41.859607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:41.860592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:41.861036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:41.861574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:41.862583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, user.id=615cc07ed65d48c5b4848df936a7d886, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:41.863084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:41.864903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:41.871598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 138/285] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/role_assignments?user.id=615cc07ed65d48c5b4848df936a7d886&scope.system=all&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:41.934487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:42.011977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b766-08a3-4067-bcea-f356d62801e4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.048444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.049423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.049890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.050366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] PATH_INFO: `/v3/users/fcc896f7fb7b47989a91bcda44a077e6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.051639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] RBAC: Authorizing `identity:get_user(user_id=fcc896f7fb7b47989a91bcda44a077e6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:42.053271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:42.055016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 148/286] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:41 2022] GET /identity/v3/users/fcc896f7fb7b47989a91bcda44a077e6 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:42.062393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.092997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:42.167010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2005eb-c98c-40b2-a31a-f02b170eebcd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.203536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.204542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.205009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.205491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.206822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:42.208499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:42.210447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:42 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:42.216353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.262655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.340370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e6003-d3c7-4696-b4ac-e9fd9a950166 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.356568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:42.393333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.394358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.395066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.396751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/users/fcc896f7fb7b47989a91bcda44a077e6/roles/16f03782a3904012a7f528350fb4c78c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.399826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, user_id=fcc896f7fb7b47989a91bcda44a077e6, role_id=16f03782a3904012a7f528350fb4c78c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:42.401573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:42.429689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:08:42 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/users/fcc896f7fb7b47989a91bcda44a077e6/roles/16f03782a3904012a7f528350fb4c78c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:42.445314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:42.457262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57aab-6c8c-47b7-9416-44f92469a19c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.517024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.517596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.517872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.518141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.533462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:42.538811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:42.539688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:42.540856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:42.546837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.683207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4fd80-0d57-4383-afa3-80aaf1e36769 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.718467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.719080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.719350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.719613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.720324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:42.720620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:42.721994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:42.732856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 150/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:42.738533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.852990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e1193-4ffe-4c15-8de5-fc6a9b2511e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:42.888804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:42.889434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:42.889706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:42.889976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] PATH_INFO: `/v3/users/8abb6a6698e147cfb6d891396c8ab11b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:42.891098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] RBAC: Authorizing `identity:get_user(user_id=8abb6a6698e147cfb6d891396c8ab11b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:42.892639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:42.894568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 141/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:42 2022] GET /identity/v3/users/8abb6a6698e147cfb6d891396c8ab11b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:42.900253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:42.947502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:43.035859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08878-86fc-40fa-8bff-ed21113fc751 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:43.081696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:43.082654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.083119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.083601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.175657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:43.177510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:43.221815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:43.283078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:43.288474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:43.324871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:43.402576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824be2d0-62ef-4422-8ea5-4f4be592bb1b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:43.437666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:43.438219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.438493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.438763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.439877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:43.441399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bde52-2c4c-45ea-a4cc-168af4df5d63 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:43.443379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:43 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:43.449289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:43.579483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0624ed-645e-470d-9f36-3464751cf836 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:43.614092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:43.614708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.614993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.615262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.616031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=8abb6a6698e147cfb6d891396c8ab11b) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:43.616340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:43.617842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1fa6-12ac-4efb-a92e-dcd5da291cc5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:43.620937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:43.624790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 152/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:43 2022] GET /identity/v3/role_assignments?user.id=8abb6a6698e147cfb6d891396c8ab11b&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:43.770836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952a63-3a64-463a-98f7-4b64171f11a0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.771358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952a63-3a64-463a-98f7-4b64171f11a0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.771358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e952a63-3a64-463a-98f7-4b64171f11a0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.773074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 143/295] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:43.778817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1b53-61db-4919-b01b-5406c067c234 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.779134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1b53-61db-4919-b01b-5406c067c234 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.779358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1b53-61db-4919-b01b-5406c067c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.799157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-933e1b53-61db-4919-b01b-5406c067c234 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:43.800433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-933e1b53-61db-4919-b01b-5406c067c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:43.885517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 153/296] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:43.910023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560df0-c621-453a-8bfc-ac31199fff10 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.910321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560df0-c621-453a-8bfc-ac31199fff10 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.910573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560df0-c621-453a-8bfc-ac31199fff10 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.912215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 144/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:43.917532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b6867-6621-452c-b808-b4298bb9e01d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:43.917815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b6867-6621-452c-b808-b4298bb9e01d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:43.918088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b6867-6621-452c-b808-b4298bb9e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:43.937475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-062b6867-6621-452c-b808-b4298bb9e01d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:43.938650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-062b6867-6621-452c-b808-b4298bb9e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:44.016454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 154/298] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:44.169789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6560df0-c621-453a-8bfc-ac31199fff10 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.269609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:44.280014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6560df0-c621-453a-8bfc-ac31199fff10 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.305814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137160-c993-43e6-9166-7ec7b8c54b84 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.306113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137160-c993-43e6-9166-7ec7b8c54b84 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.306372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3137160-c993-43e6-9166-7ec7b8c54b84 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.308111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 155/299] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:44.313440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.313724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.313998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.317305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.318191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.318651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.319102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.320405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:44.322080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:44.324492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 145/300] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:44.329885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.331777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:44.333118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:44.396159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:44.408387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 156/301] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:44.409221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.443481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7def6-3251-4971-97ae-2c2b60b4a8a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.480556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c5923-45c7-4466-a578-06001026d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.481312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5923-45c7-4466-a578-06001026d542 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.481582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5923-45c7-4466-a578-06001026d542 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.481931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c5923-45c7-4466-a578-06001026d542 None admin] PATH_INFO: `/v3/groups` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.482605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c5923-45c7-4466-a578-06001026d542 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:44.484365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c5923-45c7-4466-a578-06001026d542 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:44.503744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 146/302] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 17 11:08:44 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:08:44.537296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbc53b-8602-4631-9959-670019e1a4d7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.580140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.581231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.581699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.582155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.594930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:44.600290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:44.601177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:44.601961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:44.604933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 157/303] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:44.617426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c5923-45c7-4466-a578-06001026d542 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.642183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:44.679328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.750877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c5923-45c7-4466-a578-06001026d542 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.761114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:44.787099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.787838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.788054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.788290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.788968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:44.789269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:44.790656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:44.800635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 147/304] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:44.806094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.827373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fc518-e3b7-4e27-a9a5-1db0f5850eb8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.865996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.866637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.866910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.867180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.878127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-79fb9df2-21fa-401a-8950-85ce9517e946 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:44.883024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:44.884019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:44.884806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:44.888073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 158/305] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:44.889840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4faf6-81f7-4aa6-9a56-03a3af74b7dd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.890126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4faf6-81f7-4aa6-9a56-03a3af74b7dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.890591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:44.890763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4faf6-81f7-4aa6-9a56-03a3af74b7dd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.892385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 159/306] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:44.896724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4faf6-81f7-4aa6-9a56-03a3af74b7dd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:44.910906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb2cba-c1e8-49e6-88ad-083f093c330a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:44.944783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:44.945413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.945691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.945961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] PATH_INFO: `/v3/users/290942c3557a435686d2dcb8849a2b9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.959173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] RBAC: Authorizing `identity:get_user(user_id=290942c3557a435686d2dcb8849a2b9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:44.960709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333df541-7def-46b5-8f81-5996ff4b38c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:44.962613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 148/307] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/users/290942c3557a435686d2dcb8849a2b9f => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:44.963800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:44.964280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:44.964552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:44.985062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:44.986268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:45.012228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4faf6-81f7-4aa6-9a56-03a3af74b7dd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.025003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:45.053580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.054096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.054366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.054684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.055357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:45.055654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.057065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.064180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 149/308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:45.064180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.066313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 160/309] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:45.071409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.149602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:45.176221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296ca52-33fb-4d99-bbe5-a2174025fca8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.189032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de0f7b-5d57-4ea1-bc17-59b6166bb3c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.211460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.212134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.212415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.212691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] PATH_INFO: `/v3/users/615cc07ed65d48c5b4848df936a7d886` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.213992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] RBAC: Authorizing `identity:get_user(user_id=615cc07ed65d48c5b4848df936a7d886)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.215446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.222097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 161/310] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/users/615cc07ed65d48c5b4848df936a7d886 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:45.223016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.234952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.235898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.236415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.236874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.237778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, user.id=290942c3557a435686d2dcb8849a2b9f, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:45.238288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.240001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.245784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 150/311] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/role_assignments?user.id=290942c3557a435686d2dcb8849a2b9f&scope.system=all&role.id=16f03782a3904012a7f528350fb4c78c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:45.284558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:45.336974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a004bb-6091-4e01-aea3-47a8e37c94c6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.385511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.386214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.386490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.386758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] PATH_INFO: `/v3/system/users/615cc07ed65d48c5b4848df936a7d886/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.388228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=615cc07ed65d48c5b4848df936a7d886, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.389717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.390643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.400125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 162/312] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 17 11:08:45 2022] PUT /identity/v3/system/users/615cc07ed65d48c5b4848df936a7d886/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:45.507364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544115-1ded-482a-b390-fcb6bed65f5d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.545096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.545746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.546024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.546298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.548744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:45.559863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:45.564641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:45.565534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:45.566322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 151/313] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:45.572976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.682448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303b526-f070-49c3-b38b-d9be581d5518 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.685008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:45.718572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.719564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.720078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.720545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.721417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:45.721913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.723598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.733280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 163/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:45.739944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:45.844650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc473-aafe-4489-ae2c-26ebfafdf07d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:45.883044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:45.883683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:45.884028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:45.884844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] PATH_INFO: `/v3/users/fcc896f7fb7b47989a91bcda44a077e6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:45.885442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] RBAC: Authorizing `identity:get_user(user_id=fcc896f7fb7b47989a91bcda44a077e6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:45.887005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:45.888898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 152/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/users/fcc896f7fb7b47989a91bcda44a077e6 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:45.894546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:46.001541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958caf9-c137-4588-b09b-3d6b13af7ab9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:46.034978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:46.035599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:46.035878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:46.036180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:46.071386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:46.106249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:46.107773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:46.206656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 164/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:46.212134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:46.277513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:46.318748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfd836-0609-4ab0-9b43-64482a27d6ad None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:46.353491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:46.354175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:46.354601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:46.354880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:46.356228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:46.361261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70059-59f8-4585-93ec-c14aca66abca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:46.361261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 153/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:46 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:46.365839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:46.437757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:46.477988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4bec-20a4-48a4-a1f7-85d45f731d6d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:46.498467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d3f-9abb-4925-8950-ac3440a05701 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:46.498764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d3f-9abb-4925-8950-ac3440a05701 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:46.499024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc60d3f-9abb-4925-8950-ac3440a05701 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:46.500452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 154/318] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:08:46.506760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:46.507042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:46.507313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:46.518017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:46.518920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:46.519389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:46.519904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:46.520876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, scope.project.id=300b8a88806946f1950f3632a0a26509, user.id=fcc896f7fb7b47989a91bcda44a077e6) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:46.521392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:46.523143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:46.527227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:46.528592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:46.530331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 165/319] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:08:46 2022] GET /identity/v3/role_assignments?user.id=fcc896f7fb7b47989a91bcda44a077e6&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=16f03782a3904012a7f528350fb4c78c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:46.612043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 155/320] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:46.880915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:46.984042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e120a8-d45f-4314-a9bc-a0884d880375 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:47.012389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:47.019204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:47.019835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.020145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.020413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.021545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:47.022995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0912-eaf3-471a-a08f-5795b068c5c5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:47.024768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 166/321] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:47.030372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:47.090227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:47.132054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8628-3809-42bf-bb78-180e013ff01d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:47.165819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:47.166426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.166707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.167014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] PATH_INFO: `/v3/groups` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.167731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:47.169233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5409805-4840-4fe4-9e70-c439e7fb8627 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:47.185725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 156/322] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 17 11:08:47 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:08:47.236418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34b3a-d398-4245-b25a-caf75b073b91 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.236817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34b3a-d398-4245-b25a-caf75b073b91 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.237188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e34b3a-d398-4245-b25a-caf75b073b91 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.238906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 167/323] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:47.244608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985dfa-2d38-4fc0-8a33-ebdf6b7a9b76 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.244945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985dfa-2d38-4fc0-8a33-ebdf6b7a9b76 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.245228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985dfa-2d38-4fc0-8a33-ebdf6b7a9b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.265472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-92985dfa-2d38-4fc0-8a33-ebdf6b7a9b76 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:47.266679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92985dfa-2d38-4fc0-8a33-ebdf6b7a9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:47.342422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 157/324] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:47.401564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b776dd-8a6f-4b34-97d6-f27821c7955a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.401760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b776dd-8a6f-4b34-97d6-f27821c7955a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.402026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b776dd-8a6f-4b34-97d6-f27821c7955a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.403425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 168/325] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:47.408665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be931-0da8-4056-b289-35509eb17910 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.408947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be931-0da8-4056-b289-35509eb17910 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.409220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be931-0da8-4056-b289-35509eb17910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.428628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-160be931-0da8-4056-b289-35509eb17910 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:47.429796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-160be931-0da8-4056-b289-35509eb17910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:47.480653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:47.504633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 158/326] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:47.612871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b776dd-8a6f-4b34-97d6-f27821c7955a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:47.720998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b776dd-8a6f-4b34-97d6-f27821c7955a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:47.767451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:47.768129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.768407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.768679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.781021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:47.783265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160be931-0da8-4056-b289-35509eb17910 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:47.785978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:47.786832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:47.787625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:47.789992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 169/327] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:47.793772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:47.856701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:47.898691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72257dc-dfb9-4f63-9c92-a7c6c98b12e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:47.933244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160be931-0da8-4056-b289-35509eb17910 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:47.934538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:47.935158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.935484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.935759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.936483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:47.936844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:47.938308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:47.951060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 170/328] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:47.954080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:47.978591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:47.979273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:47.979522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:47.979797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:47.997671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:48.003540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:48.005528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:48.007385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 159/329] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:48.013580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:48.076330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:48.080233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f168-36ec-4092-a973-32a2310b6fa1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:48.118352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:48.142158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:48.142802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:48.143080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:48.143352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] PATH_INFO: `/v3/users/290942c3557a435686d2dcb8849a2b9f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:48.144523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=290942c3557a435686d2dcb8849a2b9f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:48.146136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:48.148192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 171/330] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:47 2022] GET /identity/v3/users/290942c3557a435686d2dcb8849a2b9f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:48.155641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:48.168155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7e2d9-3f98-4c5a-93c6-f8a642f3da75 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:48.237569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:48.238107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:48.238382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:48.238652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:48.240762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:48.241077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:48.242485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:48.258690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 160/331] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:48.265278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:48.361960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1b5fa-9ace-4a56-9415-cf1fb5af8cb8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:48.423818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:48.424896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:48.425185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:48.425467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] PATH_INFO: `/v3/system/users/290942c3557a435686d2dcb8849a2b9f/roles/16f03782a3904012a7f528350fb4c78c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:48.427147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=290942c3557a435686d2dcb8849a2b9f, role_id=16f03782a3904012a7f528350fb4c78c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:48.431960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:48.442339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 172/332] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 17 11:08:48 2022] PUT /identity/v3/system/users/290942c3557a435686d2dcb8849a2b9f/roles/16f03782a3904012a7f528350fb4c78c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:08:48.465028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4774e95-0105-4388-9691-02bfca414e2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:48.470507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:48.525632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:48.527082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:48.527644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:48.528132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] PATH_INFO: `/v3/users/615cc07ed65d48c5b4848df936a7d886` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:48.529641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] RBAC: Authorizing `identity:get_user(user_id=615cc07ed65d48c5b4848df936a7d886)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:48.531484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dfd41-0189-409c-8287-807f41fe3840 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:48.533572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 161/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:48 2022] GET /identity/v3/users/615cc07ed65d48c5b4848df936a7d886 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:48.539896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:48.616496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:48.669011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c01bb-8803-47fe-9ef8-09cdb0ed85d2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:48.705668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:48.706287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:48.706567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:48.706840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:48.707581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] RBAC: Adding query filter params (role.id=e8695a4f0d9046c58e5c624b69683b8c, user.id=615cc07ed65d48c5b4848df936a7d886, scope.system=all) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:48.707888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:48.709394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee3132-6b73-4b68-b58e-df71e62b0261 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:48.733764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 173/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 17 11:08:48 2022] GET /identity/v3/role_assignments?user.id=615cc07ed65d48c5b4848df936a7d886&scope.system=all&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:49.803271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e719-3433-4dd7-853f-db661eab0f4b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:49.804340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e719-3433-4dd7-853f-db661eab0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:49.804802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640e719-3433-4dd7-853f-db661eab0f4b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:49.806596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 162/335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:49.812607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:49.813504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:49.813984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:49.835575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:49.837115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:49.874071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dd91-76cd-4159-ab1e-4f3e5935e445 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:49.874397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dd91-76cd-4159-ab1e-4f3e5935e445 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:49.874617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8dd91-76cd-4159-ab1e-4f3e5935e445 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:49.876438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 163/336] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:49.884756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:49.885030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:49.885338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:49.913109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:49.914284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:49.950617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 174/337] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:50.035774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 164/338] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:50.504632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:50.558109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:50.582730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:50.700125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c608275-0c4a-4f6a-8752-ac2ec4888895 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:50.791053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:50.791986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:50.792324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:50.792603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:50.820776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:50.821542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21feddd-9981-48a8-9e18-e228ee15b453 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:50.824279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:50.829279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:50.830184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:50.830969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:50.831547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 175/339] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:50.837892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:50.876921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:50.877663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:50.877944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:50.878209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:50.894128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:50.899231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:50.900330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:50.901687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:50.904073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 165/340] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:50.909762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:50.986391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:50.989956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497c18-153a-4186-b659-dfd27317550d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.039685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.040232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.040511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.040783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.041851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:51.042437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.043456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.057200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 176/341] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:51.062792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:51.070053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a10b22-f2b7-4076-b6e8-09d9f088a492 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.115018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.115902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.116340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.116778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.117592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:51.118032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.119679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649857a0-a136-4ab8-be4c-a17eabd1d7fc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.129500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 166/342] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:51.132266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6d9e-8b5e-4c7c-8c1f-3686eead7426 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.132732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6d9e-8b5e-4c7c-8c1f-3686eead7426 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.133171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6d9e-8b5e-4c7c-8c1f-3686eead7426 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.134701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 167/343] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:51.136561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00bd6-7f63-4ec5-af9a-ba9a1d13c770 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.137028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00bd6-7f63-4ec5-af9a-ba9a1d13c770 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.137516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00bd6-7f63-4ec5-af9a-ba9a1d13c770 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.139239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 168/344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:51.140251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e00bd6-7f63-4ec5-af9a-ba9a1d13c770 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:51.170814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.191957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138ca64-c09a-4a9c-aa84-d848f7ca56b3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.225964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.226583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.226864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.227195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.260137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.269529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e00bd6-7f63-4ec5-af9a-ba9a1d13c770 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.301801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.303192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ad2a1-e88b-4aa1-978e-fa97e2ec1152 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.310222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.310848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.311127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.311403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.387876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.389481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d405-e95b-4c53-bf93-e843b129dfb0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.415860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.420041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 177/345] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:08:51.421708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.422304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.422577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.454477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:51.456062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:51.521465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 169/346] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:51.522744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.523026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.523299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.539891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.540106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 178/347] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:51.544643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:51.545910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:51.547402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:51.637215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 170/348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:51.638191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:51.674807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4802ea-3be0-4df5-94f0-92257a1fe032 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.713347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.714042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.714344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.714639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.715793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.717754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe11133-b929-4a78-884e-08276f839162 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.719848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 179/349] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:51 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:51.721402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25689a3-19e9-485d-92aa-092262e9611a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.721684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25689a3-19e9-485d-92aa-092262e9611a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.721957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25689a3-19e9-485d-92aa-092262e9611a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.723412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 180/350] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:51.730302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.730302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.730302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.740508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.753885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:51.755343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:51.820268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:51.832396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 181/351] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:51.834592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:51.839943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6678-62e9-4afd-8e29-a43be39e519a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.878462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.879161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.879442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.879709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.880905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:51.882454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762416a-a3a4-47b2-921b-6045888958ef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:51.884524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 171/352] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:51 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:51.889395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bf4-0790-4b6b-990d-63b3c524e927 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.889611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bf4-0790-4b6b-990d-63b3c524e927 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.889889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74bf4-0790-4b6b-990d-63b3c524e927 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.891332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 172/353] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:51.898197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.898481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.898762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:51.918401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:51.919724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:51.958696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e33bff-c672-4b02-86aa-185ffd299442 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:51.997387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:51.998028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:51.998350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:51.998634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.005240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.006814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.008942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 182/354] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:51 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.013074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.016080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 173/355] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:52.017145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.083436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.085379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.135663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f1d9c-4f13-4303-b3f3-57d98b0a822f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.148384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83698b67-3e16-4b3b-b106-6eab4363124b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.172231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.172871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.173150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.173417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.174543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.175991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.182563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 183/356] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.183614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.189284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.190202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.190488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.190759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.202943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:52.207968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:52.208854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:52.209670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 174/357] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:52.210320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.313727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b319-7c09-4589-8fb3-9de744882b29 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.341648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.342189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af20082-7401-438b-afc5-4bedfb65fcd0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.356868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.358629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.362030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.362030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.362030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.372276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:52.377715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:52.378589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:52.379382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 184/358] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:52.383665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.384336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.384718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.384878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.385039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.385796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:52.386521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.387667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.393779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 175/359] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.394595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.524094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b41d-ae28-412d-b45a-c71c8a6f2293 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.538471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506630c1-c902-47ea-8359-075fe0d46b34 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.568594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.569493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.569763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.570038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.577691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.577691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.577921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.578090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.579671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=558419835357498886a96d0af76609b8, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:52.580876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.581422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.583788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:52.587536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 176/360] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=558419835357498886a96d0af76609b8 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.590625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:52.590763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:52.591593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 185/361] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:52.592401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.648377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.649630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.727797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187abd4-9ab2-4fa4-9377-2c82a41690e8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.739951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44629989-4e68-4bca-8ddc-ed52fed9206c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.774513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.775108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.775377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.775755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.776465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:52.776771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.778222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.788464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.789111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.789383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.789658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.790645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 177/362] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.791687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.811875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:52.818636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:52.819502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:52.820931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 186/363] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:52.821578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.906584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1fd3c-a39b-4ae7-b088-fa0489d8e924 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.910299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.940020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264548-dcda-4b77-9b7f-0c17b590db21 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:52.949117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.949743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.950021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.952144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.952352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:52.952886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:52.953228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.954982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.966138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 178/364] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.967063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:52.978392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:52.979050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:52.979442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:52.979931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:52.980613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:52.980914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:52.982289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:52.994603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 187/365] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:52.995487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.076132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1654-1bed-4bc8-aa43-f79081a6d1d0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.103562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255cac0-61ab-4d12-9c5a-633a3008ea5f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.111423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.112113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.112390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.112705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] PATH_INFO: `/v3/users/290942c3557a435686d2dcb8849a2b9f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.113920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] RBAC: Authorizing `identity:get_user(user_id=290942c3557a435686d2dcb8849a2b9f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.115369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.122645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 179/366] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/users/290942c3557a435686d2dcb8849a2b9f => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:53.123670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.143563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.144375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.144651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.144923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.145596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:53.145895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.147482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.158940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 188/367] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:53.159799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.180397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.193729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.242094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515527-699c-41ab-8da4-5996bb7dbd67 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.266698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb2f99-fc32-4f9c-81ce-ff9b00533023 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.277815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.278433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.278710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.278980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.301893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.302507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.302782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.303048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.354064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.355729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.376363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.377861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.388792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.407318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.463674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 180/368] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:53.464473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.487101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 189/369] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:53.488492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.594502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f99b7-9623-4415-8cc2-a2f75d50aeb7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.628712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c6154-7b82-41ae-b635-7862d07e1c91 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.634247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.646945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.647573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.647846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.648134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.648862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] RBAC: Adding query filter params (role.id=16f03782a3904012a7f528350fb4c78c, user.id=290942c3557a435686d2dcb8849a2b9f, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:53.649164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.650675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.665542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 181/370] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/role_assignments?user.id=290942c3557a435686d2dcb8849a2b9f&scope.system=all&role.id=16f03782a3904012a7f528350fb4c78c => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:53.670336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:53.672102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.679254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.681606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.682262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.686786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.822474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.824428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.889058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305485-15a8-4728-8baa-e1e4955f9557 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:53.938209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:53.938850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:53.939125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:53.939401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:53.940634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:53.943063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:53.945079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 182/371] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:53.945945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:53.981904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 190/372] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:08:53.982776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.013538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.024163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.084783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274181cd-004c-48b8-ae93-175f15636bc2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.100368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565bbcc-642c-4224-9eb5-b2071cc648d5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.139519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.140118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.140513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.140797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.142032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.143512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.144844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.145457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 183/373] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.150999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.151136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.151136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.151136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.152166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.153582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.155326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 191/374] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:53 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.155986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.273634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.281034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392483b-2e27-4f31-96c5-321c7f77e7d0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.283450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e2b62-c6bc-44d9-bb15-1166b7d5ec5a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.310271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.326048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.327019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.327482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.328080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.329517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.330031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.330675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.330948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.331214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] PATH_INFO: `/v3/projects/28f251e503a640598b723ca0a0d78c6b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.332065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.332363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] RBAC: Authorizing `identity:get_project(project_id=28f251e503a640598b723ca0a0d78c6b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.333780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.334626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 192/375] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.335634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 184/376] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/projects/28f251e503a640598b723ca0a0d78c6b => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.335741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.341176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.460109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c26efc-c627-45d7-a9a5-1a792421840e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.467807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564f828-6695-45b5-a3e2-42e3817b3013 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.505662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.506699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.507163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.507616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] PATH_INFO: `/v3/groups/92463bd1a99e41d4b1b86173e019159b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.516859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.517480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.517757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.518028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.518767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=300b8a88806946f1950f3632a0a26509) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:54.519074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.520585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.523646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] RBAC: Authorizing `identity:get_group(group_id=92463bd1a99e41d4b1b86173e019159b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.525646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.530236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 193/377] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.531276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.531738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 185/378] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/groups/92463bd1a99e41d4b1b86173e019159b => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.538626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:54.572715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.650716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:54.678027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9e214-6f72-4896-ac3f-0475b66c0852 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.718199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc81cc1-5746-4e7c-b712-ee803f897420 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:54.730835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.731470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.731752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.732055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.732797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=558419835357498886a96d0af76609b8, scope.project.id=300b8a88806946f1950f3632a0a26509) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:54.733220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.734763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db50e3-0a55-4f34-90f8-ac3413f69404 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.742721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 194/379] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=558419835357498886a96d0af76609b8 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.744091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540a0d-a92f-43ca-a532-e897132f3a8f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.744469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540a0d-a92f-43ca-a532-e897132f3a8f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.744751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540a0d-a92f-43ca-a532-e897132f3a8f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.746234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 195/380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:54.752244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.752553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.752791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.774682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:54.775314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.775636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.775909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.781118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:54.782238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] RBAC: Adding query filter params (group.id=92463bd1a99e41d4b1b86173e019159b, role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=28f251e503a640598b723ca0a0d78c6b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:54.782595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:54.784140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b381da-9688-4cb9-9aec-fd03f7d5675c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:54.784413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:54.791639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 186/381] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:08:54 2022] GET /identity/v3/role_assignments?group.id=92463bd1a99e41d4b1b86173e019159b&scope.project.id=28f251e503a640598b723ca0a0d78c6b&role.id=a17fbd5f1a91411583f4436858306f31 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:54.852506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a992ac4-805b-44d8-830f-d9929537c3d7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.853140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a992ac4-805b-44d8-830f-d9929537c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.853647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a992ac4-805b-44d8-830f-d9929537c3d7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.857102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 187/382] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:54.862229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:54.862881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:54.863349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:54.894748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:54.898491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:54.924221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 196/383] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:54.997888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 188/384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:55.225368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.251428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:55.340061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8766c7a-94eb-48fb-9ad6-1516fecff1a0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:55.384719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:55.385432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:55.385707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:55.386022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:55.403364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:55.408089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:55.408988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:55.409790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 197/385] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:55.414977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.418655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.484289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:55.542733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a261457-2f4e-43be-97b9-1520b563b622 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:55.585617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:55.586230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:55.586503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:55.586773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:55.587444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:55.587737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:55.589442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:55.608155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:55.610586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 189/386] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:55.616405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.646451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5923e-a57f-43ac-94a5-d399c10eb3a5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:55.710866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:55.712541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:55.713327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:55.714574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:55.736787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:55.742298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:55.743161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:55.743951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 198/387] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:55.755607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.835666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ddaa-9838-45e4-a049-37480bbc2632 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:55.859224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:55.899481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e812850-8e71-43b7-8bd6-648e214e4ae6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:55.911389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:55.912408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:55.912907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:55.913384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:55.914817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:55.916845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:55.919227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 190/388] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:55.925581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.948068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:55.948743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:55.949028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:55.949301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:55.950034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:55.950753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:55.952021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:55.968538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 199/389] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:55.974788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:55.977619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:56.043780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65949a-1342-463b-b829-6fd28e4b3458 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:56.102297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:56.103124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168979c-4345-44d0-92ce-c75f7b9b0900 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:56.103391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:56.103825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:56.104207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:56.108846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:56.110494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:56.113427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 191/390] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:56.118971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:56.149062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:56.151815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:56.152265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:56.153069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:56.156136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:56.157927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:56.160946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 200/391] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:55 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:56.167816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:56.216348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:56.311476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:56.328591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d3310-d17e-4384-b770-2e77e53fd32c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:56.375316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1945375-cd4f-4232-9a66-e7d851450be9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:56.398486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:56.399418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:56.399951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:56.401078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:56.405218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, group_id=2ea2e5222ed64bbdab9c504d4c33582c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:56.407938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:56.432671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 192/392] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 17 11:08:56 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:08:56.445886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:56.446801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:56.447249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:56.447665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:56.449148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:56.450966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582eef1-9a48-44e1-bf09-c818625e0e00 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:56.453316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 201/393] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:56 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:56.459042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:56.583767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf15643-3ae5-4a8b-b699-47e25305c30b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:56.596087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:56.631209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:56.632177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:56.632599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:56.633012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/558419835357498886a96d0af76609b8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:56.636615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1cf08186ea4ba0bd3b2347505ad602, group_id=2ea2e5222ed64bbdab9c504d4c33582c, role_id=558419835357498886a96d0af76609b8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:56.638269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e8cd5-9fdf-47ad-90af-efcd1170417b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:56.655661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 193/394] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 17 11:08:56 2022] PUT /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/558419835357498886a96d0af76609b8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:57.079379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5b80-9593-4151-8e8e-397cf496cfa4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.079558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5b80-9593-4151-8e8e-397cf496cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.079839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5b80-9593-4151-8e8e-397cf496cfa4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.081745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 202/395] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:57.084639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817bc1-66c4-4bc7-bab7-2d61634f99d8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.085080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817bc1-66c4-4bc7-bab7-2d61634f99d8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.085153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817bc1-66c4-4bc7-bab7-2d61634f99d8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.087892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67425f-e5e8-43f5-96fe-9a285d5f8a93 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.088252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67425f-e5e8-43f5-96fe-9a285d5f8a93 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.088667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67425f-e5e8-43f5-96fe-9a285d5f8a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.095361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 194/396] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:57.104827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb7ad-e6d4-4af4-97ad-37b757c223ad None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.105307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb7ad-e6d4-4af4-97ad-37b757c223ad None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.105954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb7ad-e6d4-4af4-97ad-37b757c223ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.111986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8b67425f-e5e8-43f5-96fe-9a285d5f8a93 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:57.112684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b67425f-e5e8-43f5-96fe-9a285d5f8a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:57.135982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-590bb7ad-e6d4-4af4-97ad-37b757c223ad None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:57.137495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-590bb7ad-e6d4-4af4-97ad-37b757c223ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:57.204664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 203/397] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:57.252849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 195/398] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:57.327822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85530e7-d787-4e8a-92cf-d58ef6d9b053 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.328349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85530e7-d787-4e8a-92cf-d58ef6d9b053 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.328422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85530e7-d787-4e8a-92cf-d58ef6d9b053 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.329953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 204/399] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:57.336558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.336843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.337117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.358511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:57.359702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:57.441392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 196/400] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:57.511442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85530e7-d787-4e8a-92cf-d58ef6d9b053 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:57.596171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:57.636259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85530e7-d787-4e8a-92cf-d58ef6d9b053 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:57.678318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:57.678949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.679220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.679482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.698722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:57.703411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:57.704318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:08:57.705484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:57.706092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:57.706163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 205/401] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:08:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:57.713481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:57.778021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:57.864970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a232-180b-420b-908e-4f448408cfbc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:57.872071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c2ada-ac60-49b0-8d5c-7a6bd119798c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:57.900496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:57.913992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:57.914610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.914882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.915146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.915815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:57.916171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:57.917595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:57.919847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:57.920526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:57.920798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:57.921061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:57.936226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:57.936624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 206/402] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:57.937775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:57.939604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:57.940566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:57.942208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 197/403] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:57.946277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.044321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.046249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765889-fd62-4e66-b9fd-853604f7799c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.048847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85b541-5334-4736-91d0-d37033bff80d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.088760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.089401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.089679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.090061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.095098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.096517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.097103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.097528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] PATH_INFO: `/v3/groups/92463bd1a99e41d4b1b86173e019159b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.099278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] RBAC: Authorizing `identity:get_group(group_id=92463bd1a99e41d4b1b86173e019159b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.101130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.101838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:58.103220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 198/404] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:57 2022] GET /identity/v3/groups/92463bd1a99e41d4b1b86173e019159b => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.105278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:58.108939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:58.110059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:58.111056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 207/405] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:58.118419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.169993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.224106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22344418-ce18-43e5-af50-d26a1c7dde77 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.224338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9f03c-8d1f-4bed-9862-32a14393f0af None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.260739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.261211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.261809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.262083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.262352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.262691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.263015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:58.263327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.263626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.264129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] PATH_INFO: `/v3/projects/28f251e503a640598b723ca0a0d78c6b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.264724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.265775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] RBAC: Authorizing `identity:get_project(project_id=28f251e503a640598b723ca0a0d78c6b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.267412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.273638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 208/407] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/projects/28f251e503a640598b723ca0a0d78c6b => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:08:58.274834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.277894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 199/407] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.279093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.300034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.379646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb555e-aeed-48c8-a0c3-6ac19b5c4525 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.384812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f65afa-9c29-4366-9762-63220a46e8d9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.397837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.416765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.417711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.417860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.418240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.419013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:58.419415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.421339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.423571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.424567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.424990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.425403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] PATH_INFO: `/v3/projects/28f251e503a640598b723ca0a0d78c6b/groups/92463bd1a99e41d4b1b86173e019159b/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.427451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] RBAC: Authorizing `identity:create_grant(project_id=28f251e503a640598b723ca0a0d78c6b, group_id=92463bd1a99e41d4b1b86173e019159b, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.429174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.436035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 209/408] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.437280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.448333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 200/409] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 17 11:08:58 2022] PUT /identity/v3/projects/28f251e503a640598b723ca0a0d78c6b/groups/92463bd1a99e41d4b1b86173e019159b/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:58.455552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.548324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdcba6-cf2a-4a53-9f4d-cbbac15acda4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.585532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.586623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.586623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.587110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.588488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.590227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.599948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 210/410] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.599948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.608332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.678199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a16af-7489-4197-a9ac-788810b28fcd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.684267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.723881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.725023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.725522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.725979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.727329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.729108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.731476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 201/411] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.740430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.757418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141db4-5b2c-4b0d-91fa-03b1a0433f75 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.802201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.802836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.803115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.803387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.804574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.806018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5835f09-13df-4e66-bda7-5fff5d2fb15f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.808256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 211/412] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.811948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d365-7a99-4c26-ab6c-9f72fb058d30 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.811948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d365-7a99-4c26-ab6c-9f72fb058d30 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.811948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233d365-7a99-4c26-ab6c-9f72fb058d30 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.811948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 212/413] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:58.816319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233d365-7a99-4c26-ab6c-9f72fb058d30 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:58.883060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cf7ff-1d39-4d2d-b735-a4c477546941 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.926919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.927820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233d365-7a99-4c26-ab6c-9f72fb058d30 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:58.928319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.928785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.929256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.931666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.933366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258340d-d799-437a-91f3-a308c0f2e171 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.935565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 202/414] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:08:58 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:58.937369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492286-42ed-494d-bc2c-9fa03460a7fd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.937851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492286-42ed-494d-bc2c-9fa03460a7fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.938634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23492286-42ed-494d-bc2c-9fa03460a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.945879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.962168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23492286-42ed-494d-bc2c-9fa03460a7fd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:58.963972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23492286-42ed-494d-bc2c-9fa03460a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:58.966585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:58.967464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:58.967946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:58.968603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:58.970301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, group_id=2ea2e5222ed64bbdab9c504d4c33582c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:58.971895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:58.976888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:58.996587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 213/415] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 17 11:08:58 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:08:58.996587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.089091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 203/416] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:08:59.090403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83457-3355-4bdd-81d3-b6756361799d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.090687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83457-3355-4bdd-81d3-b6756361799d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.090954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83457-3355-4bdd-81d3-b6756361799d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.092445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 204/417] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:08:59.097887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.098489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.098489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.117658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:08:59.119279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:08:59.156643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda526-0dbd-4d87-8031-7593e4f4ef08 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:59.194941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:59.195275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 205/418] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:08:59.195559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.195841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.196145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/558419835357498886a96d0af76609b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.199741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] RBAC: Authorizing `identity:create_grant(project_id=300b8a88806946f1950f3632a0a26509, group_id=2ea2e5222ed64bbdab9c504d4c33582c, role_id=558419835357498886a96d0af76609b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:59.201222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:59.217022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 214/419] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 17 11:08:58 2022] PUT /identity/v3/projects/300b8a88806946f1950f3632a0a26509/groups/2ea2e5222ed64bbdab9c504d4c33582c/roles/558419835357498886a96d0af76609b8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:08:59.418607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.488623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.502630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:59.530353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a8d91-bbe0-4364-9a03-3a47a03d1823 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:59.565711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:59.566695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.567158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.567611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.578992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:59.581021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:59.585477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:59.586819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:08:59.587738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:08:59.590021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 206/420] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:08:59.595832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.669176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf649-610b-4627-a465-c871baa7dd82 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:59.699279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34bcd5-e621-465c-9339-ec80dd0e5372 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:59.704985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:59.705622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.705901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.706175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.717471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:08:59.722853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:08:59.723738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:08:59.724558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:08:59.725171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 215/421] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:08:59.737108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.768668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:59.769299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.769580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.769854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.770534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:59.770834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:59.772291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:59.773915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:59.801662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 207/422] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:59.808861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.852300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:08:59.857880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732173-62d7-497d-8b56-5bd40c396ec9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:08:59.894483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:08:59.895159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:08:59.895443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:08:59.896012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:08:59.896559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:08:59.896868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:08:59.898316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:08:59.907867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 216/423] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:08:59.921119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:08:59.968771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e19f6-dc30-45d9-a0ea-18c64394fcc8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.005771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.006741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.007221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.007693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.080276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.082334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.091157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:00.190702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 208/424] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:00.198639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:00.230294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04b86-e257-45d0-9c77-ba0e40fcbce6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.325794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:00.326749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.327618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.328118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.328683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.332018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6986e-0643-4ed2-8d76-dae0ff84296a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.361175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:00.387870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.388532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.388804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.389074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.396765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.398258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.400135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 209/425] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:09:00 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:00.408846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:00.420733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.422513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.580350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab82ed-8a51-4f4d-80b6-c2ede64a8027 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.615203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 217/426] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:09:00.616124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.616786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.617052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.617325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.618523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.620090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.622002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 210/427] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:09:00 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:00.623030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:00.632936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:00.687407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:00.690612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:00.769374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3804f40-90f6-4f62-bb8d-eb885aa8a0ec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.806450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007e1cd-73bc-4631-afe5-e80d92deb79b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:00.815722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.816396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.816669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.817043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] PATH_INFO: `/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.818173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] RBAC: Authorizing `identity:get_project(project_id=3a1cf08186ea4ba0bd3b2347505ad602)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.819732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01354425-a4d3-4d10-a97c-1503535cb67e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.825039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 218/428] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:09:00 2022] GET /identity/v3/projects/3a1cf08186ea4ba0bd3b2347505ad602 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:00.825039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8f97-63ab-42f4-997a-ce782b7bbb72 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.825039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8f97-63ab-42f4-997a-ce782b7bbb72 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.825039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d8f97-63ab-42f4-997a-ce782b7bbb72 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.828927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 219/429] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:00.829693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8f97-63ab-42f4-997a-ce782b7bbb72 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:00.855134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:00.856096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.856803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.857253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.858653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:00.859415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:00.861730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dcd14-dd19-4494-be04-0ebddc7991a3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:00.871303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 211/430] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:09:00 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:00.872988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:00.873435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:00.873903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:00.899949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:00.901943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:00.942901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d8f97-63ab-42f4-997a-ce782b7bbb72 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.006078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:01.026327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 212/431] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:01.027856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.028738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.029242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.029717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.031070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:01.032714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:01.039422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 220/432] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:09:00 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:01.041269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:01.084377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:01.160212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05451f-8948-4345-bc5c-95483e144e7e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.196219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.197894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.198389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.198830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.199732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=558419835357498886a96d0af76609b8, scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:01.200242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:01.201862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c9d6-3291-49a2-89c3-75ee846e3427 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:01.208461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 213/433] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=3a1cf08186ea4ba0bd3b2347505ad602&role.id=558419835357498886a96d0af76609b8 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:01.341227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:01.365825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205c83-0a2f-46f5-a7c9-c87ab0506e61 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.366166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205c83-0a2f-46f5-a7c9-c87ab0506e61 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.366357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205c83-0a2f-46f5-a7c9-c87ab0506e61 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.367693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 214/434] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:01.377004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.377276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.377554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.406670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:01.407870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:01.466018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f64d8-b57e-41b2-a544-11b8b0315941 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.502668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 215/435] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:01.508700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.509395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.509764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.510035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.525260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d8a45249-dc3f-44d1-824a-38f5032d0444 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:01.530144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:01.530995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:01.531894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 221/436] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:01.537153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:01.560800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:01.618154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c09b7-1515-4451-ad89-96c8c291b210 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.618712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c09b7-1515-4451-ad89-96c8c291b210 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.618712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c09b7-1515-4451-ad89-96c8c291b210 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.620351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 222/437] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:01.625352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.625634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.625900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.640988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee959-df4b-400c-9b6e-e220b1354363 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.648614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:01.649818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:01.685035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.685762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.686042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.686411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.687083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:01.687379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:01.688912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:01.697840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 216/438] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:01.704052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:01.720091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:01.753144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 223/439] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:01.772595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:01.811806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:01.833624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56807e1-3feb-4688-a83d-18931e41ba4f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.885996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.885996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.885996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.885996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.901577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40b2a3-a840-47c1-b70a-06cec0165f54 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:01.950392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:01.951025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:01.951307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:01.951574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:01.963296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:01.966169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:01.967821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:01.968379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:01.969434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:01.970287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 224/440] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:01.975092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.024410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.058002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.076912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 217/441] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 11:09:02.077970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.085385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bd1f5-6fbf-455b-9205-53d90942f3a2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.117650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.118250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.118522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.118818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.119480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:02.119775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.121179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.129765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 225/442] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:09:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:02.130552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.179684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5a1a8-4d37-4d9d-8d7a-dd02cb3560fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.214028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.214635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.214923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.215197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.225061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:02.225172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bdd1e-efb3-4bb8-8f9d-52f536d6c8bb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:02.229900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:02.230964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 218/443] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:02.232857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.233550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.262348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.262970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.263244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.263508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] PATH_INFO: `/v3/projects/28f251e503a640598b723ca0a0d78c6b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.264655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] RBAC: Authorizing `identity:get_project(project_id=28f251e503a640598b723ca0a0d78c6b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.266082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.267696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 226/444] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/projects/28f251e503a640598b723ca0a0d78c6b => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:02.268506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.276721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.334445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964198fc-0151-4dec-a0e4-491f3fde2357 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.367386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.368018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.368212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143294cb-dc13-430e-9a88-193d901a5011 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.368315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.368549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.403271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.403870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.404177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.404444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.405107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:02.405407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.406769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.414793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 227/445] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:02.415619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.435944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.437415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.452397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.478395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.518984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c77e5a-fcbb-489b-986f-a3dc3292abf7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.537709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 219/446] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:02.538681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.553073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.553707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.553982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.554254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] PATH_INFO: `/v3/groups/92463bd1a99e41d4b1b86173e019159b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.555363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] RBAC: Authorizing `identity:get_group(group_id=92463bd1a99e41d4b1b86173e019159b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.556986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.558550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 228/447] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/groups/92463bd1a99e41d4b1b86173e019159b => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:02.559299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.637048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b77-c590-4837-96d4-821c98d58357 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.655700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035504a-65fe-4938-beb5-7c395a1d395a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.658089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.671642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.672285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.672564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.672831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.685360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.689342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.689965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.690243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.690522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.691635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.693109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.694720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 229/448] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:02.695468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.746610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.748131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.797325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9ca1-2ec2-418a-a730-efac15875f1d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.831709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:02.832340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:02.832619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:02.832891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:02.833616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] RBAC: Adding query filter params (group.id=92463bd1a99e41d4b1b86173e019159b, role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=28f251e503a640598b723ca0a0d78c6b) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:02.833922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:02.835366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:02.841356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 230/449] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/role_assignments?group.id=92463bd1a99e41d4b1b86173e019159b&scope.project.id=28f251e503a640598b723ca0a0d78c6b&role.id=a17fbd5f1a91411583f4436858306f31 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:02.842151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.862337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 220/450] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:02.868099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:02.890421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.918796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:02.961806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad99963-7461-40e1-a856-5dad72f7e791 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:02.984053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aa642-2103-4b7b-88be-ef0bff13b6ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:03.002483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:03.003072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:03.003321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:03.003591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:03.004761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:03.007650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:03.007766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 231/451] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:03.014225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:03.028325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:03.028970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:03.029302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:03.029576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] PATH_INFO: `/v3/projects/300b8a88806946f1950f3632a0a26509` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:03.030702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=300b8a88806946f1950f3632a0a26509)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:03.032178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:03.033962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 221/452] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:09:02 2022] GET /identity/v3/projects/300b8a88806946f1950f3632a0a26509 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:03.039441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:03.114539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2905cc2-a186-428c-95b8-9a5b8297a76b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:03.116778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:03.138417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118618-b47f-402c-b9a4-98f44834d7a5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:03.147888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:03.148570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:03.148786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:03.148895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:03.149106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:03.149988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=e8695a4f0d9046c58e5c624b69683b8c, scope.project.id=300b8a88806946f1950f3632a0a26509) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:03.150474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:03.152201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:03.157894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 232/453] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:09:03 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=e8695a4f0d9046c58e5c624b69683b8c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:03.174157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:03.174807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:03.175080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:03.175347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] PATH_INFO: `/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:03.176535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] RBAC: Authorizing `identity:get_group(group_id=2ea2e5222ed64bbdab9c504d4c33582c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:03.178025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca415e-d3b9-4abf-8648-0b741d1a2745 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:03.179852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 222/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 17 11:09:03 2022] GET /identity/v3/groups/2ea2e5222ed64bbdab9c504d4c33582c => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:03.186193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:03.294958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119035ac-4bf7-4f84-9439-1d24e1070075 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:03.332412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:03.333018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:03.333334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:03.333595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:03.334328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] RBAC: Adding query filter params (group.id=2ea2e5222ed64bbdab9c504d4c33582c, role.id=558419835357498886a96d0af76609b8, scope.project.id=300b8a88806946f1950f3632a0a26509) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:03.334636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:03.336133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396db3-6811-4ecc-9392-423d3f10b0c7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:03.342096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 233/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 17 11:09:03 2022] GET /identity/v3/role_assignments?group.id=2ea2e5222ed64bbdab9c504d4c33582c&scope.project.id=300b8a88806946f1950f3632a0a26509&role.id=558419835357498886a96d0af76609b8 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:05.936246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8697cb-4b99-48ec-8adb-dc4d6cfacaac None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:05.937268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8697cb-4b99-48ec-8adb-dc4d6cfacaac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:05.937747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8697cb-4b99-48ec-8adb-dc4d6cfacaac None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:05.939562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 223/456] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:05.945323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5b5d-910b-402c-b5e1-e20f97e2907e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:05.946151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5b5d-910b-402c-b5e1-e20f97e2907e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:05.946686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f5b5d-910b-402c-b5e1-e20f97e2907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:05.972954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f6f5b5d-910b-402c-b5e1-e20f97e2907e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:05.974521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f6f5b5d-910b-402c-b5e1-e20f97e2907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:06.013879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:06.034924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c871e-2774-4ebf-ab04-591c0a626a43 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.035576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c871e-2774-4ebf-ab04-591c0a626a43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.035899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c871e-2774-4ebf-ab04-591c0a626a43 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.038847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 224/457] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:06.043810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc126-b88a-4815-aa39-7e6fd02a9eeb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.044352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc126-b88a-4815-aa39-7e6fd02a9eeb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.044832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc126-b88a-4815-aa39-7e6fd02a9eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.064665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-853bc126-b88a-4815-aa39-7e6fd02a9eeb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:06.066182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-853bc126-b88a-4815-aa39-7e6fd02a9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:06.078447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 234/458] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:06.156344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 225/459] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:06.262140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d58-6db1-4cfb-a686-12a4d4e35016 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.262488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d58-6db1-4cfb-a686-12a4d4e35016 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.262695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d58-6db1-4cfb-a686-12a4d4e35016 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.264399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 235/460] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:06.269530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.270044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.270523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.296330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:06.297895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:06.384024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 226/461] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:06.423116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6d58-6db1-4cfb-a686-12a4d4e35016 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:06.527347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6d58-6db1-4cfb-a686-12a4d4e35016 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:06.563046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:06.564243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.564759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.565249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.576576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:06.578310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b9d41c12-8f9a-41ee-b94c-5625c60ce8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:06.593374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:06.594280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:06.595122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:06.595122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:06.595122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:06.601262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 236/462] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:06.603576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:06.612428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8adb9-2f3b-4d61-914e-5c65e549f524 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.612716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8adb9-2f3b-4d61-914e-5c65e549f524 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.612994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8adb9-2f3b-4d61-914e-5c65e549f524 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.615461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 237/463] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:06.622681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.623886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.624548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.657531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:06.660307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:06.678416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:06.678994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:06.752055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 238/464] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:06.753188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:06.754941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e654d-34c1-461b-ad25-f7bed90a2aec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:06.801917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:06.802907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.803187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.803722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.804417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:06.804971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:06.807022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:06.831572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 227/465] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:06.832521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:06.871892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc8c0-0e1e-41f2-8baf-200c0e7bb7ee None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:06.918879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:06.919826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:06.920162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:06.920682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:06.935442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:06.936938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:06.938299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:06.940166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:06.945980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94d0f-a4b4-4675-87c7-a1442a4e673a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:06.953701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:06.954881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:06.955708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:06.955708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:06.955708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:06.955708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 239/466] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:06.955949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.005157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.005811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.006092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.006368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.020520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.022913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:07.042652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:07.043643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:07.044537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:07.044537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:07.044537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:07.044537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 228/467] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:07.044749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.073771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be965-83bb-46e6-998b-a2087ad94397 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.112085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.112693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.112970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.113241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.113878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.115311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.139902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 240/468] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:06 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:07.141158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.158477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ec3f8-f687-4695-8769-8dbd9321c737 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.201606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.204401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.205306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.205747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.206191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.207049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:07.207529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.209168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.228872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 229/469] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:07.228872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.244783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.259843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71911e7a-ff41-45c4-9051-9844acae6088 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.301203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.301851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.302119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.302391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.315522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.317048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d2f894db-540e-4d3a-9a07-93473b73ca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:07.333868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:07.334796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:07.335639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:07.335639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:07.335639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:07.335639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 241/470] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:07.336251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d0c3-eb2f-4c78-8e47-87a9fd9ec99a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.336464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d0c3-eb2f-4c78-8e47-87a9fd9ec99a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.336737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5d0c3-eb2f-4c78-8e47-87a9fd9ec99a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.338675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 242/471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:07.339406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d0c3-eb2f-4c78-8e47-87a9fd9ec99a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.347889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df74c5-bb70-470f-b892-8fae3c756d29 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.386310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.387191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.387468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.387735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.388569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:07.388870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.390883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.405324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 230/472] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:07.406153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.452152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5d0c3-eb2f-4c78-8e47-87a9fd9ec99a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.455718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.483533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.490730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.491342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.492058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.492332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.493340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.495109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d3712-b5a1-476d-b689-e17c8761667e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.516310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a832-8a41-4aed-a8b9-536c9a5a1cef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.527964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 243/473] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:07 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:07.527964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.527964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.527964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.554994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:07.557238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:07.567019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.567647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.567949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.568239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.568890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:07.569186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.570669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.585702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 231/474] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:07.586543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.660084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 244/475] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:07.661089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:07.721962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef6e46-d869-4b41-9442-4421f124618c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.755724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.762931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.763982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.765129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.765555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.766500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.768089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.793928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 232/476] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:07 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:07.802791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:07.817850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb51d93-3acc-448a-b1f6-dfb4ecfe972f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:07.862740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:07.863830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:07.864363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:07.864822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:07.865711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:07.867428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:07.902474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 245/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:07 2022] POST /identity/v3/users => generated 249 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:08.001030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:08.166072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70c8d5-4919-4f48-8301-410360f94ff4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:08.205472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:08.206103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:08.206380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:08.206650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:08.207320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:08.209265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:08.218569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.sql.core [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 11:09:08.218569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 11:09:08.218569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [parameters: {'id': 'aa8b2a35680442a3951299927139a85b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 11:09:08.218569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Aug 17 11:09:08.234644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:09:08.235550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application yield resource Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise self.value Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application session.commit() Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 11:09:08.236841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.flush() Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application compat.raise_( Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 11:09:08.237706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:09:08.238572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:09:08.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [parameters: {'id': 'aa8b2a35680442a3951299927139a85b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:08.241332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 11:09:08.242297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:08.243359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 233/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 17 11:09:07 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:08.243447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:08.386653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ee736-eb80-400e-acf3-7df29f282ed9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:08.451327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:08.451903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:08.452220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:08.452495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:08.474891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d938e09b-77a6-4538-8567-bd56f5e09e5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:08.480342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:08.481432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:08.482407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 246/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:08.487458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:08.560495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:08.626682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc076ca-e23e-4da0-b726-ac0d2b230e4a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:08.680204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:08.680934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:08.681211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:08.681483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:08.682152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:08.682449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:08.683927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360d0f5-a94b-4152-b232-5dade510df82 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:08.697163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 234/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:09.424643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0af7d-946f-4d56-92a8-6429cacb2089 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:09.425166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0af7d-946f-4d56-92a8-6429cacb2089 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:09.425166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0af7d-946f-4d56-92a8-6429cacb2089 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:09.426769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 247/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:09.437358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abdca-7bdb-41b3-9bf7-cd3bd62a635f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:09.437792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abdca-7bdb-41b3-9bf7-cd3bd62a635f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:09.437969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3abdca-7bdb-41b3-9bf7-cd3bd62a635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:09.464866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af3abdca-7bdb-41b3-9bf7-cd3bd62a635f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:09.466067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af3abdca-7bdb-41b3-9bf7-cd3bd62a635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:09.538625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 235/482] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:09.854138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0af7d-946f-4d56-92a8-6429cacb2089 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:09.863852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.001624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0af7d-946f-4d56-92a8-6429cacb2089 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.043607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.044281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.044561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.044834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.047521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cf0d-cd31-457c-9674-660c15e25cbe None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.047802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cf0d-cd31-457c-9674-660c15e25cbe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.048105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98cf0d-cd31-457c-9674-660c15e25cbe None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.049702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 236/483] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:10.054534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ae75-4003-4d48-b09e-600f7e597b67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.054845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ae75-4003-4d48-b09e-600f7e597b67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.055081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ae75-4003-4d48-b09e-600f7e597b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.076652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:10.081376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:10.082218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.083000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:10.086408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3fe2ae75-4003-4d48-b09e-600f7e597b67 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:10.087958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3fe2ae75-4003-4d48-b09e-600f7e597b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:10.090322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 248/484] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:10.091172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.164325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.206040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.230502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 237/485] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:10.252040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed2551-7487-4b57-9a70-83d7b037a516 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.285759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.286372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.286648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.286918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.287588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:10.287892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:10.289488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:10.298690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 249/486] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:10.303260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cff57c-f2bb-4650-8ca2-5832babbd73d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.303544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cff57c-f2bb-4650-8ca2-5832babbd73d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.303824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cff57c-f2bb-4650-8ca2-5832babbd73d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.305186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 238/487] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:10.306179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.311955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.312246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.312518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.343114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:10.344345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:10.436588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 239/488] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 11:09:10.498008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048e1d-191c-4735-8f7d-19242c88f1c1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.537901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.544423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.547435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.548205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.548487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.548758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.564671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:10.566135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:10.581500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:10.583556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:10.585670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:10.585670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:10.585670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:10.585670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 250/489] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:10.593556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.728474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57e24e-7205-4e28-9bb0-b9e8080357bc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.730039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.745143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440103-d8fd-4615-8147-5cb5b7054423 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.766998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.767934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.768221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.768495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.780359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.780969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.781240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.781336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:10.781500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.782135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:10.782429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:10.783779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-dbfd3206-e5b1-4929-a147-0cc55d06fdd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:10.786680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:10.787523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 240/490] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:10.793686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89d25-5618-41a3-91c9-10c568405b34 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.794397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89d25-5618-41a3-91c9-10c568405b34 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.794397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89d25-5618-41a3-91c9-10c568405b34 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.796133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 241/491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:10.797357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89d25-5618-41a3-91c9-10c568405b34 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.799343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 251/492] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:10.800269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.843985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:10.904933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad7e7e-9e15-4c31-9906-97ad5a797bcb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.909262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89d25-5618-41a3-91c9-10c568405b34 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:10.939744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.940423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.940701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.940971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.941717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:10.942019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:10.943389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6752b9-d265-43bd-be1f-93f883354e73 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:10.945125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:10.945757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.946030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.946474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.951811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 252/493] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:10.952920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:10.953205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:10.953476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:10.962166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:10.966895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:10.967775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:10.968608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 242/494] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:10.969835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:10.976739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:10.978144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:10.994379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.052077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 253/495] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:11.052077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.081004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c5d1f-a442-4032-981c-e0dacff979fa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.086035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.120139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.121057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.121478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.122011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.130966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.132838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:11.147123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:11.148071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:11.149031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:11.151448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 243/496] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:11.152543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.175248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467cff8-bc45-48a1-9f9a-2b4f9707079f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.218477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.219606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.220066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.220400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.233336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.235659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.247068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:11.253655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:11.254538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:11.255472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:11.255472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:11.255472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:11.260095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 254/497] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:11.260996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.272774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f69d13-032a-4794-b5fb-412f6afd3b1f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.310322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.311301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.311840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.312350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.313347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:11.313866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.315585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.324760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 244/498] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:11.325840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.356363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.371579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113955e-9b08-40f2-a4e6-ae4b0048f344 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.405958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.406563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.406839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.407110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.407842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:11.408173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.409623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.434030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612e1e6-fe8b-4ce3-826a-ccc49ebf66ee None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.446786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 255/499] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:11.447611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.469137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.469742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.470017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.470287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.470923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:11.471224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.472638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.484107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 245/500] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:11.485187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.489514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.552257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d67ed-4d95-468d-9b94-64f9b6c1d01e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.583676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b1614-1912-4318-9035-f19915a659ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.584902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.585535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.585811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.586106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.596326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5b4c11cd-7f22-4c37-8ba5-04eb61d17836 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:11.600989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:11.601908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:11.602718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 256/501] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:11.603399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd52c0-7ff5-41a5-a901-9adb20694f18 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.603894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd52c0-7ff5-41a5-a901-9adb20694f18 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.603894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd52c0-7ff5-41a5-a901-9adb20694f18 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.605022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 257/502] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:11.605716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd52c0-7ff5-41a5-a901-9adb20694f18 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.608865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.622754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.623406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.623664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.623952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.634517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.636002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:11.651051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:11.652055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:11.652895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:11.652895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:11.652895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:11.652895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 246/503] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:11.653117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.710847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.711611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd52c0-7ff5-41a5-a901-9adb20694f18 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.748532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.749154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.749429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.749698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.756198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41bab-8b73-4c57-a97e-8110b2cadf2b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.788962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.789592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.789932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.790203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.798082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.799550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:11.810474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:11.811439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:11.812643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 247/504] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:11.813214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:11.819682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.821228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2e15b-529b-4d28-adbb-0d3eada229e0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.823135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.913622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d806cc-0c1f-4c67-8d51-f6cb65072087 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:11.917995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 258/505] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:11.919042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.919322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.919587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.931734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:11.938440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:11.939616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:11.951794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:11.952764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:11.953215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:11.953689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:11.954552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:11.954854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:11.956249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:11.964607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 248/506] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:11.965395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.016817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 259/507] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:12.017782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.058687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.068742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d18e58-6621-4a77-b5e0-49c2e843903b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.108821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.110137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.110517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.110797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.111448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.111798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.113152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.130792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 249/508] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.130792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.136528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aa346-8f9f-432d-90af-14f67fcaa178 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.171286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.171492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.172149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.172429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.172697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.173421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.173722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.175174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.192461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 260/509] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.193264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.248154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2ac66-b3ef-4878-8f92-1d23f9c1e74b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.283166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.283789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.284101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.284370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.285642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.294706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.296435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625b9fb-44b7-4191-8cdf-d2c28b439dfa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.296547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:12.310752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:12.311700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:12.312601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:12.312601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.312601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:12.312601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 250/510] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:12.312824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.332584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.333214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.333490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.333761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.344276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.345720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:12.363718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:12.364716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:12.365531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:12.365531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.365531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:12.365531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 261/511] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:12.366174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.411136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.421509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb68e1-1f6f-4d70-b303-8ec9a5e861a9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.456279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.456820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.457101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.457372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.465377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca6821-d7cb-461d-b98b-e33010cf2fa9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.465945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.467402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:12.478227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:12.479120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:12.480044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 251/512] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:12.480593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.501292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.501899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.502171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.502439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.514486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.570754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.573043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.581305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1861-4a84-427e-ac92-92906f102c01 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.616054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.616668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.616941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.617214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.628120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.629570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:12.648027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:12.652774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:12.653660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:12.653660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:12.653660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:12.653660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 252/513] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:12.653660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.654766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.684667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 262/514] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:12.685768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.730710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.758307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ea07b-b928-4183-a514-3f3569252e7f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.792536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbf172-3a4a-49d3-93d8-ea31f30c75cc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.792891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.793500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.793776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.794045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.794687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.795007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.796706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.809020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 253/515] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.809827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.827799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.828442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.828716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.828980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.829641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.829941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.831306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.842248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 263/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.843024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.870593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.909287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c60d88-8bcc-4ed0-b1af-3aafc0be7924 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.947844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541a75d-b0bb-4504-b39e-b761215a0a1d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:12.949781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:12.950905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125931b4-eea6-491a-b455-33154db9961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.951751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125931b4-eea6-491a-b455-33154db9961a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.952133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125931b4-eea6-491a-b455-33154db9961a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.952410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125931b4-eea6-491a-b455-33154db9961a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.953168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125931b4-eea6-491a-b455-33154db9961a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.953472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125931b4-eea6-491a-b455-33154db9961a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.954939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125931b4-eea6-491a-b455-33154db9961a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.983021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:12.983629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:12.983906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:12.984206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:12.984857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:12.985159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:12.986520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:12.992474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 254/517] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.994049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125931b4-eea6-491a-b455-33154db9961a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:12.998510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 264/518] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:12.999404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.098798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125931b4-eea6-491a-b455-33154db9961a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.099089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d6b6-b5dd-4ba2-922b-62767a1fe73a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.119648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.134737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.135351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.135624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.135893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.136598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.137228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.137504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.137771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.142523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.143981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.148525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.150012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:13.155401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:13.156325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:13.157164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 265/519] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:13.157618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:13.166767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:13.167699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:13.168558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:13.168558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:13.168558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:13.168558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 255/520] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:13.168787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.188042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.261971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4dc0-f40a-487b-9255-a7d4dc218a34 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.274744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4db6e-cb7c-4100-8820-f5b312ed8118 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.294073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.294692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.295074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.295550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.303413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.304893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.307622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.308247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.308520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.308787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:13.317096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:13.317978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:13.318862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 266/521] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:13.319410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.352403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.378732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.380248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.401830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.420173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50184-5d97-4804-834f-bd827734cae4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.454931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.455524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.455797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.456118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.456748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.458159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.476566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 256/522] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:13.477525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.490529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 267/523] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:13 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:13.490529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.568940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.601027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b3cf6-3a76-45bb-ab3e-3efcc28258d2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.605127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458df08-5c24-48c1-a0c6-b514fe418030 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.640825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.641438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.641713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.641977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.642677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:13.642982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.643526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.644170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.644424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.644517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.644698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.645395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:13.645699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.647150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.652902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.662490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 268/524] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:13.663408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.666220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 257/525] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:13.667198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.777515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4663ec8-ce24-4fd8-bee9-0e65bed26232 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.781749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430164e1-7430-44a1-ab67-88f75851e576 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.815576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.816218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.816499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.816779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.817312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.817508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:13.817818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.819536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.823223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.824108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.824550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.824983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.837435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 269/526] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:13.838281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.838469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.840228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:13.856342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:13.857389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:13.858215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:13.858215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:13.858215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:13.858997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 258/527] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:13.860179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:13.897745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:13.942716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97308-66b9-40dd-825a-728c078cc49a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.978532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe587f7f-6289-44b9-8dfd-dea58c42f28f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:13.980328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:13.981870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:13.982191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:13.982433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:13.991053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:13.993640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:14.009807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:14.010654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:14.011570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 270/528] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:14.012671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.018887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.019497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.019743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.020198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.020924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=ded8007ff9d64b5b809eef243b8d7895) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:14.021219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.022611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.028800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 259/529] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:13 2022] GET /identity/v3/role_assignments?user.id=ded8007ff9d64b5b809eef243b8d7895&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:14.029567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.093121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.155386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77394-22e9-4fe5-8b99-b8c7fee291d5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.174310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d773a5-26de-4211-b7fd-4cab6c8eda44 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.174559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.197340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.198319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.198790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.199250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.217500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.218107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.218351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.218621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.219272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:14.219568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.220993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.232919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 260/530] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:14.237866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.287589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.289458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.339025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce7b1e-91bc-4501-bd50-d44a7ff43838 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.352559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.382456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.384024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.384531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.385408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.386600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:14.387109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.389523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.410237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 261/531] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:14.410237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.416990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 271/532] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:14.418149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.437865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.523488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9f8b-1b3e-4412-8f87-3e3dacc2f703 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.541108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1736dc9-515d-48b5-9871-0cf049c8e0d5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.559629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.560331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.560537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.560801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.561527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:14.561829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.563288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.575944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 272/533] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:14.575944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.611049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.611618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.611895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.612186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.625727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.628615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:14.656314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:14.657656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:14.658514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 262/534] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:14.668121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.736339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.753509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:14.783855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55e9c-b9b2-44d6-ac2e-059ca8420c3e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.825790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.826774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.827247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.827712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.839778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.841884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:14.858035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:14.858969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:14.859806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:14.859806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:14.859806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:14.861948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 273/535] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:14.866886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:14.870243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc40c6-b579-40ff-be15-52401f897c16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.960397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:14.961019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:14.961623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:14.961623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:14.962717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:14.962938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:14.964442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:14.982281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e0da0-8783-48c4-86ab-52b439c13bd4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:14.995445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 263/536] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:15.013047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:15.019849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:15.027117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:15.027968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.028414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.028836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.029626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:15.030069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:15.031602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:15.044822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 274/537] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:15.057210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:15.132296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:15.147081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37035129-fa55-4a0b-87c9-5eea31aa4bf0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:15.183894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:15.184699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.185070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.185439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.186303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=4d42cfa2d2e9453d879c623cae849ed5) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:15.186707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:15.188392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:15.206289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 264/538] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:15 2022] GET /identity/v3/role_assignments?user.id=4d42cfa2d2e9453d879c623cae849ed5&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:15.208258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16190-548f-4367-a44d-f466511e1394 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:15.246037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:15.246678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.246955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.247221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.254343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:15.255814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:15.267794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:15.268809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:15.269638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 275/539] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:15.277059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:15.414019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5b5d-328c-451e-a554-a860105058e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:15.448641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:15.449248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.449523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.449790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.450485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:15.450784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:15.452364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333b9e1-af73-4087-88be-8b1b3c2dc20a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:15.466292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:15.472089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:15.559035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:15.612261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb30-429b-495d-a53f-d6121d4fa206 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:15.646035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:15.646649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.646925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.647193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.647944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=41154775379d4f0da94e06f8f3fd1455) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:15.648254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:15.649873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:15.651876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51fcd-1c36-40af-ad6e-dfb134804242 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.652189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51fcd-1c36-40af-ad6e-dfb134804242 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.652455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51fcd-1c36-40af-ad6e-dfb134804242 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.654021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 266/541] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:15.655849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 276/542] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:15 2022] GET /identity/v3/role_assignments?user.id=41154775379d4f0da94e06f8f3fd1455&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:15.670827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564fb63-8a0c-4b08-b8fa-d2300cff9c17 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:15.671361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564fb63-8a0c-4b08-b8fa-d2300cff9c17 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:15.671361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564fb63-8a0c-4b08-b8fa-d2300cff9c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:15.713179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9564fb63-8a0c-4b08-b8fa-d2300cff9c17 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:15.714425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9564fb63-8a0c-4b08-b8fa-d2300cff9c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:15.723276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:15.812847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:16.101536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.121329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d2b-2dfd-42b1-8f45-52d3db56ec99 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.121658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d2b-2dfd-42b1-8f45-52d3db56ec99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.121865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d2b-2dfd-42b1-8f45-52d3db56ec99 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.123199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 268/544] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:16.128976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.129326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.129600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.155587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:16.156787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:16.272569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea9bd-849d-467c-9576-021077596cc1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:16.278574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 269/545] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:16.292313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:16.321803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:16.322806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.323084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.323356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.343940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:16.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:16.350013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:16.350787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:16.353066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 277/546] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:16.358041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.463909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:16.505559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3d8f-1027-4842-a2d8-dbb2646f1346 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:16.552691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:16.553307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.553588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.553863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.554539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:16.554839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:16.556446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:16.565131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 270/547] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:16.572985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.651195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.722084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bfaf7-a6e6-4ee7-bdc1-e9b1f240830c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:16.778056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:16.778685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.778959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.779226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.790515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:16.792089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:16.807130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:16.808072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:16.808890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:16.808890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:16.808890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:16.808890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 278/548] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:16.814112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.842983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:16.863195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99b1f8-b002-49a6-bff4-7dd5cd733926 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:16.909012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:16.910143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.910533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.910808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.917593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:16.918976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5bce-5e3f-42c0-8182-f587197fd497 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:16.927123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8aa79614-760c-47fd-974e-4ef75f706e9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:16.936263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:16.937285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:16.938610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:16.939389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 271/549] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:16.940245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d97f6-f026-47f7-ac49-191522a777fc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.943936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d97f6-f026-47f7-ac49-191522a777fc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.943936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d97f6-f026-47f7-ac49-191522a777fc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.943936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 272/550] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:16.944949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d97f6-f026-47f7-ac49-191522a777fc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:16.960776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:16.961598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.962141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.962141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:16.962729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:16.963362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:16.964453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244729b2-04be-4511-8154-c431cfd00a9b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:16.977917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 279/551] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:16.979265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:16.979445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:16.979709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.002341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:17.003577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:17.067435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d97f6-f026-47f7-ac49-191522a777fc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.087267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 280/552] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:17.088687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.106761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.107837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.108372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.108741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.109515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:17.109918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.111493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.111959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.132489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 273/553] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:17.138986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.200841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.245776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14073fb-0a27-4a52-8000-79b38547bbba None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.279773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.280757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.281256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.281816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.292977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.294728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.297992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1439a-9b7e-433c-99e4-7408ae9ae24f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:17.310068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:17.311106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:17.312026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:17.312026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:17.312026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:17.314098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 274/554] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:17.319659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.384666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.385317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.385649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.385919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.412271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.413832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.437291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2229-4474-4e0e-ac16-15d48940fa1b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:17.447112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:17.448076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:17.449000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:17.449585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.449682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 281/555] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:17.456715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.490309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.490935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.491215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.491487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.492173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:17.492503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.496269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.518627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 275/556] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:17.519723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.573012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.596587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9b07-280c-4142-a324-de65c334df86 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.631677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.632326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.632653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.632930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.633779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:17.634088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.635523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.655981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 282/557] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:17.655981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.661520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fef84-d199-45cf-9673-1c517fd3ac13 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.699406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.700466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.700891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.701145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.712514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d213b4d6-b930-40ad-aedb-6d0620bc06db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:17.717333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:17.718795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:17.719621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 276/558] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:17.720799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92cff-056b-4f37-ac8c-457e69a5a78e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.720799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92cff-056b-4f37-ac8c-457e69a5a78e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.720799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e92cff-056b-4f37-ac8c-457e69a5a78e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.721581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 277/559] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:17.722108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e92cff-056b-4f37-ac8c-457e69a5a78e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.758691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.774868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164430-87c9-4857-9bd6-1b98282a87b9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.809254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.809883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.810155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.810422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.813502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:17.818260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.819969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:17.832038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:17.833116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 283/560] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:17.834094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:17.853143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e92cff-056b-4f37-ac8c-457e69a5a78e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.892458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.893517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.893865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.894277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.940740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ec1dd-e3de-4cf8-a71b-4bfca3408de2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:17.975676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:17.976217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.976491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.976758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:17.977706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:17.978029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.978286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:17.979540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.980308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d007c-8c3b-411f-8a04-78a0c93cb288 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:17.990665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 284/561] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:17.992205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cd0b-a56a-4ff0-9231-749afc3730ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:17.992576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cd0b-a56a-4ff0-9231-749afc3730ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:17.992972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783cd0b-a56a-4ff0-9231-749afc3730ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.006542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.011012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6783cd0b-a56a-4ff0-9231-749afc3730ea None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:18.012220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6783cd0b-a56a-4ff0-9231-749afc3730ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:18.065539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.080329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 278/562] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:18.080329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.082946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 285/563] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:18.084209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0cc7-397c-491b-95fb-613d1da6d9f9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.084492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0cc7-397c-491b-95fb-613d1da6d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.084759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0cc7-397c-491b-95fb-613d1da6d9f9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.086109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 286/564] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:18.086894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0cc7-397c-491b-95fb-613d1da6d9f9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.186998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d123ed-ceaa-4012-9995-b69f62e6ba21 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.190731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0cc7-397c-491b-95fb-613d1da6d9f9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.214031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.224791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.224953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.225404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.225582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.225722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.225880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.225970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.226110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.226663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:18.227155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.228656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.237059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.238493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.251414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 279/565] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:18.251414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-60b0e921-5c40-4225-b105-c6458f68871a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:18.258754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.259709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:18.260608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:18.260608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.260608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:18.264211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 287/566] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:18.266256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.266534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.266808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.286552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:18.287749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:18.322034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.354490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2af4-ceb2-4c95-9753-149344514a14 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.361064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 288/567] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:18.361895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.397828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.398546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.398955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.399297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.409873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.411400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:18.426677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.427787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:18.428907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:18.428907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.428907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:18.428907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 280/568] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:18.428907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.469479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea3369-4bde-465b-b04c-5a675a2e0a2c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.470077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.504619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.505168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.505439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.505702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.516957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.518404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:18.532692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.533801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:18.534664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:18.534664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:18.534664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:18.534664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 289/569] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:18.534664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.535525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913710b-4069-4c8d-99b4-e9bf31c6751f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.560721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.575209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.576199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.576478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.576747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.577388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:18.577698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.579189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.595895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 281/570] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:18.596575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.636132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677333c5-2499-4332-9cf5-686ee65836ce None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.669261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.669896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.670200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.670782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.682212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:18.687363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.688336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:18.689154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 290/571] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:18.689826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.694784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.699378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbe65f-9a35-475c-8f16-4019bb559cee None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.737405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.738041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.738318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.738623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.739213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:18.739515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.740920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.754268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 282/572] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:18.755143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.773910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.792952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb2151-66b6-44b3-ad69-bc115e807682 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.826273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.826879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.827157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.827429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.828107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:18.828411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.829775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.841648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 291/573] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:18.842493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.858438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f196e-c263-4df9-a69f-dbc7233b1fde None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.893079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.894098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.894380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.894653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.901523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:18.902984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:18.914770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.915783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 283/574] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:18.916800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:18.937198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:18.943102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ac75-7f62-42c8-8304-66d752571c8b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:18.980988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:18.981626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:18.981903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:18.982181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:18.992532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:18.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:18.998451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:18.999304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 292/575] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.000353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.002333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.024574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9f7b-1ddc-4839-832d-1e1319ec92f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.060179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.060789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.061070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.061345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.062012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.062321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.063814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.071847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 284/576] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.072669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.103182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0ab78-edf8-4a2c-981c-eb47d9831871 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.136488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.137117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.137394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.137661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.144206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.145652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.155707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:19.156781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:19.157819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 293/577] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.163561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.182610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fc2c0-eedc-4f49-9983-40f5fa245f49 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.214517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.215140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.215426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.215690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.222265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.223701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.223842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:19.234840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:19.235910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 285/578] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.236859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.262697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21573a-9e71-4262-a1bb-d0c42bafcf62 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.297755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.298296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.298572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.298842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.299568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.299872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.301328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.317994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 294/579] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.318807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.338816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780695c7-b758-4e47-9dd8-7f0ba9d40ae7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.374419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.375031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.375309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.375575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.376288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.376584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.377967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.386170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 286/580] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.386926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.389550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.421391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa7c41-22eb-4cd3-94f1-70c869cc3b77 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.440876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.456148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.456773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.457048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.457314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.467136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.468602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:19.483008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:19.484086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:19.484965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:19.484965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.484965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:19.484965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 295/581] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.484965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.491061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803139f-3d53-4912-bc01-d6ed2c33ff0a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.524946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.525548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.525821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.526086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.526769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.527068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.528530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.540392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 287/582] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.541337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.585798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d2f3-0f1b-4aa8-837f-ed9a64950172 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.603382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.619398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.620127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.620486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.620821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.621578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.621943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.623450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.640842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 296/583] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.641723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.641822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84f526-ae72-4e89-8bdb-0ce8ee9994b2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.673859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.679097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.679879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.680329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.680686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.691074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.692578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:19.706830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:19.707757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:19.708695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:19.708695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.708695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:19.708695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 288/584] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.708695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.748832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b189-a33b-4285-8b72-fba6d4c1275a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.784363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.784989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.785270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.785513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.796933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.798391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.811522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79995d7-b815-4af3-aa56-81fbb0fc0bd8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:19.813482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:19.814611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:19.815677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:19.815677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:19.815677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:19.815677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 297/585] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:19.815677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.828459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.855358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.855879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.856189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.856488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.857125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.857444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.859085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.871302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 289/586] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.872111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.909845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:19.926443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1acd68-5a69-4977-a641-4dd50ecbefa5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:19.958265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:19.958874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:19.959145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:19.959408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:19.960155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=89e54d17894648ff81de2b23119732fa) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:19.960465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:19.962263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:19.967566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 298/587] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/role_assignments?user.id=89e54d17894648ff81de2b23119732fa&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:19.968359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:19.977267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf57ab3-40e3-4eec-ba17-d4542b852112 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.024863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.025700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.026050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.026379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/ded8007ff9d64b5b809eef243b8d7895/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.043549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=ded8007ff9d64b5b809eef243b8d7895, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.045076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.069460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 290/588] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:19 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/ded8007ff9d64b5b809eef243b8d7895/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:20.069460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.089647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56554c67-377f-442d-aa14-e7039c91523c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.105084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.146251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.146947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.147226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.147596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.148370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:20.148762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.151037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.166522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 299/589] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:20.167484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.180994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.200085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec371-eecf-4026-84dd-f7a879e52253 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.244571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.245473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.245908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.246181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.246836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:20.247135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.248588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.261206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 291/590] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:20.262047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.296350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0af7-40d7-4989-91bb-9fca5b6f5c8a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.343703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.344665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.345118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.345550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.355606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.357409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:20.370379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:20.371573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:20.372676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:20.373357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.375001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 300/591] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:20.375985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.394208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89864e54-f117-4638-8935-1d33ae956e77 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.441651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.442682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.443035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.443376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.448461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.455282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.456857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:20.473547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:20.474708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:20.475820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:20.477032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 292/592] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:20.478281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.494818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db24b9-6633-450e-bf41-5ae0effb9969 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.540616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.542228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.542904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.543934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.556412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.558614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:20.573524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:20.574765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:20.575965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:20.579988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 301/593] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:20.581080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.605233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12844-9fff-406b-9cc1-5b359016af34 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.649915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.650681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.651048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.651409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.652784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:20.653202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.655252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.678497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 293/594] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:20.679547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.683111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.716317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb04fd-9f11-46f2-a90b-4f2ea52787dc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.748150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.760274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.761017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.761433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.762347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.763146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:20.763805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.765615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.783792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 302/595] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:20.785307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.805988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242300e2-7012-4b20-9041-15df2956a0fa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.852711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.853510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.853878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.854236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.855384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:20.855782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.858260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.887997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 294/596] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:20.889069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:20.901150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148e7b6-b05e-4029-9106-add80995c4da None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:20.946373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:20.947384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:20.947753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:20.948196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:20.952660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:20.963638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:20.965732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:20.984304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:20.985493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:20.986685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:20.986685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:20.986685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:20.992295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 303/597] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:20.992295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.016577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dce573-7064-4335-9306-a1cae2d778c6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.033543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.067651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.068620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.069046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.069464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.089917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=991c9767714849039e301854775dac09, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.092287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.098107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892767d2-42be-42e6-b216-27a1c5fd2537 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.112076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 295/598] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:20 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:21.113450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.157918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.159005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.159465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.159894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.186781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.191071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:21.230059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:21.231276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:21.232435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:21.232435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:21.232435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:21.234012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 304/599] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:21.240066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.317671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c199f-b0f7-4c6f-a5ee-ddbe477a9547 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.331042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.361275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.361889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.362166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.362435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.363089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:21.363393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.364800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.376851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.388717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243537b-a604-47c4-b49c-6f891662284d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.394161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 296/600] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:21.401538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.427908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.429154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.429596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.430286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.431083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:21.431532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.433543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.447996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 305/601] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:21.453915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.568440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301f9f-e09b-4ae8-90a2-6cef03394078 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.606810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.607788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.608237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.608675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.616275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.617978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:21.630168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:21.631277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:21.632409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:21.634703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 306/602] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:21.641006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.663026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef89155-dca1-4c5a-9e14-44c425f5ddde None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.665190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.756665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.757566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.757566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.758097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.765619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.767153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.771003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5fc01-8095-4126-90af-7c98fe5a799e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:21.792789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:21.793950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:21.794980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 297/603] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:21.800997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.811746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:21.812625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:21.813045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:21.813460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:21.814327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:21.814776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:21.816450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:21.830365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 307/604] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:21.836759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:21.878370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.922648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:21.957812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a599a-9cf2-4dd3-ae6d-809090443a41 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:21.999908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:22.001427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.001850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.002284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/41154775379d4f0da94e06f8f3fd1455/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.019434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=41154775379d4f0da94e06f8f3fd1455, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:22.021801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4044a-208f-4bc2-b3e6-227ceb7de052 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:22.044004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 308/605] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:21 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/41154775379d4f0da94e06f8f3fd1455/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:22.058087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3a509-47eb-4a8f-a76d-48a475996b97 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:22.071710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdcba-750f-4c5a-8ec9-06f57e4924fb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.072542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdcba-750f-4c5a-8ec9-06f57e4924fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.073022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fdcba-750f-4c5a-8ec9-06f57e4924fb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.074998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 309/606] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:22.082799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c51a-4f35-42f6-a433-9df355b3e0b4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.083406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c51a-4f35-42f6-a433-9df355b3e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.083879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c51a-4f35-42f6-a433-9df355b3e0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.106364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bca8c51a-4f35-42f6-a433-9df355b3e0b4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:22.108000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bca8c51a-4f35-42f6-a433-9df355b3e0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:22.127367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:22.128028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.128490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.128759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.129464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:22.129766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:22.131601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:22.163086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 298/607] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:22.166016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:22.247712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 310/608] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:22.249449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98c04-0c7c-4939-bc24-1899f1283818 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.249740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98c04-0c7c-4939-bc24-1899f1283818 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.250301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f98c04-0c7c-4939-bc24-1899f1283818 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.251941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 311/609] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:22.257972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.258258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.258542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.278601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:22.279867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:22.307283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:22.317742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a9ce-3273-45fd-84ac-69c08aa62519 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:22.332187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:22.353213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 312/610] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:22.358944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:22.359632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.360013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.360297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/4d42cfa2d2e9453d879c623cae849ed5/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.376017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=4d42cfa2d2e9453d879c623cae849ed5, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:22.377479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:22.394766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 299/611] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:22 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/4d42cfa2d2e9453d879c623cae849ed5/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:22.534423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:22.650025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6903d-c70e-4bf9-a87a-13e147ea0c0d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:22.686636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:22.687280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.687559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.687883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.698480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:22.703279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:22.704217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:22.705046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 313/612] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:22.710619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:22.718939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:22.803565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:22.839519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a3d5f-3208-426f-a232-bec1490fbeaa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:22.876907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:22.877524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:22.877802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:22.878071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:22.878746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:22.879042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:22.880938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:22.890545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 300/613] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:22.896965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:22.904325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:22.949516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9fe9c-a75e-49bd-b8b1-eb4e4c099adf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.011298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.011947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.012221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.012487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.033898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:23.039098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:23.040157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:23.041017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:23.041650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 314/614] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:23.047576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.077079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde10d-2783-4463-97d0-15e64850d7bc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.146414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.147480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.147994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.148500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.174003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.175825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.193415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec891bc6-eb24-4413-be1d-850635f951be None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.195615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:23.203856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:23.204821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:23.205705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:23.205705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:23.205705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:23.212600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 301/615] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:23.213574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.261650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.262642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.263174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.263640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.264548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:23.265762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.267333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.282002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 315/616] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:23.294471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.320583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:23.390475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac952a9-a440-4d5c-ba58-41aa86b80f60 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.434009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac6d9-06e7-4e0f-a463-e8521eb2bae1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.446080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.447029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.447529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.448142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.449145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:23.449652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.451330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00022c4-2428-4119-8030-dfe464accb16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.465041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 302/617] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:23.467027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e375-c2c7-497a-93dc-3844e7ab2ded None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.467537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e375-c2c7-497a-93dc-3844e7ab2ded None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.468050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e375-c2c7-497a-93dc-3844e7ab2ded None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.473602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 303/618] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:23.473729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.473729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.473729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.473729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.475119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57e375-c2c7-497a-93dc-3844e7ab2ded None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.483419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.484976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8b1f60b1-7325-4c46-b49d-3ef21d1e6fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:23.499647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:23.500703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:23.501571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:23.501571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:23.501571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:23.501571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 316/619] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:23.502617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.502617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.502882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.521923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:23.523171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:23.535952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:23.593879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57e375-c2c7-497a-93dc-3844e7ab2ded None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.599938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 317/620] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:23.599938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.621696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:23.676657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.677314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.677593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.677865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.700724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3751de-a1e0-4adb-9053-fd33498005b0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.700911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.702144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:23.730109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:23.731253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:23.732219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:23.736739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.737434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.737715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.737966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 304/621] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:23.738067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.738628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:23.738929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.740340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.748946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.753065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 318/622] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:23.764892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.780235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:23.913733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623373e7-016b-4c68-a68d-645f65e5ce28 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.955208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.955616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd507f6b-fcf5-45a8-a837-7ac536d38f05 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:23.955738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.956036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.956311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:23.957042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:23.957346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:23.958957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:23.984991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 305/623] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:23.986400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:23.994511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:23.995503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:23.996131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:23.996626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.005323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.007246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:24.021445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:24.022488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 11:09:24.023679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:24.025132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.026805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 319/624] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:24.027796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.108190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.114192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845ffda-4773-4b7c-b7bb-9df129d3af69 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.150693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a2d13-ce2c-46fb-a4f0-39413186a277 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.155388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.156554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.157041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.157550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.169050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:24.174585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:24.175525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:24.176427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:24.184747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 306/625] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:24.185998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.186582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.187208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.187482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.187749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.202456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.204532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:24.225134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:24.226146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:24.227166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:24.227166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:24.227166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:24.227166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 320/626] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:24.228210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.306815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.322944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c16dc-7cbc-449b-b769-554c06e263b4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.360401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.361035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.361309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.361577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.362621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:24.363057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.364663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.365497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cec38-64f9-4990-899f-860bccf107e3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.387689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.389672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 307/627] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:24.390892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.413812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.414443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.414702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.414966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.415640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:24.415961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.417331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.429689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 321/628] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:24.430609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.501483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da270f9-fa11-4e0f-b126-7ca520648f92 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.535961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.536571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.536845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.537122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.537761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:24.538062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.539853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.540197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6bdc6-85b1-417b-b940-40fe030ea7a8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.557451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 308/629] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:24.557451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.568311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.582038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.582693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.582976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.583252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.634551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.657608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.659083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2b095-1599-415e-afcd-6c4723139c24 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.666868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f95c2-4f99-4bb3-a69a-106f88fee5eb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.700792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.701426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.701707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.701981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.712727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.714179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-261a2c0f-4a6f-4421-ab59-6112a2e0b984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:24.728611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:24.729555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:24.730419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:24.730419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:24.730419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:24.730419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 309/630] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:24.730888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8fdff-dd8b-4fb5-8f87-39122b1c237e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.731141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8fdff-dd8b-4fb5-8f87-39122b1c237e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.731416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8fdff-dd8b-4fb5-8f87-39122b1c237e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.732671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 310/631] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:24.733359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8fdff-dd8b-4fb5-8f87-39122b1c237e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.766479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 322/632] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:24.767675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184529f-95db-48fa-9047-b5ce5478adb3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.767982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184529f-95db-48fa-9047-b5ce5478adb3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.768256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184529f-95db-48fa-9047-b5ce5478adb3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.769484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 323/633] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:24.770163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184529f-95db-48fa-9047-b5ce5478adb3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.800808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.841769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8fdff-dd8b-4fb5-8f87-39122b1c237e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.850383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:24.871316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184529f-95db-48fa-9047-b5ce5478adb3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:24.875735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.876412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.876686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.876952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.883814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.885445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-af57e805-edc1-4e2d-bc71-da0ef6ccf150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:24.896153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:24.897185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:24.898108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 311/634] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:24.898740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14792d1-8fe3-42e1-b625-96456da2ce6e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.898740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14792d1-8fe3-42e1-b625-96456da2ce6e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.899020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14792d1-8fe3-42e1-b625-96456da2ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.910375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:24.910989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.911265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.911531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:24.912202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:24.912500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:24.913939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:24.915713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c14792d1-8fe3-42e1-b625-96456da2ce6e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:24.916924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c14792d1-8fe3-42e1-b625-96456da2ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:24.925876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 324/635] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:24.926675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:24.985789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 312/636] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:24.987338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:24.987622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:24.987894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.017569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:25.018692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:25.033157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9de6e-bfb7-4cda-9c60-b0a682157d11 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.071249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.071880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.072185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.072285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.072453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.084225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.090662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.092462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.104095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 313/637] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:25.104095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:25.121614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:25.125225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:25.126398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:25.126398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:25.126398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:25.131937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 325/638] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:25.131937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.214427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4ab7b-266c-4796-85dd-61600a6990fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.250093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.250707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.250986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.251282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.252009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:25.252315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.253584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a99c58-5686-4c3b-817b-34c0962794b4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.253746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.266658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 314/639] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:25.267461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.293031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.293585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.293853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.294129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.302446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.303882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.314065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:25.314948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:25.315975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:25.317070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:25.321028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 326/640] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:25.322099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.373886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.380018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27167e56-c8ca-40b5-97d0-b86da8870812 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.413589 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.414444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.414585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.414793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.415430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:25.415725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.417145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.420529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5fa30-1ee2-423a-baa4-324f044150ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.428707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 315/641] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:25.429574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.458374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.459000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.459270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.459524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.469676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:25.475369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:25.476528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:25.477384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 327/642] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:25.478134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.533794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15318e37-df36-4165-9f00-d99638347e98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.535330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.569812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.570528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.570788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.571056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/89e54d17894648ff81de2b23119732fa/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.574471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748fa9a-1bcf-4031-9162-2e57b1ff079b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.584887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=89e54d17894648ff81de2b23119732fa, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.586370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.587267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.599146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 316/643] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:25 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/89e54d17894648ff81de2b23119732fa/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:25.599950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.610441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.611071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.611348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.611625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.612415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:25.612730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.614247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.639287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 328/644] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:25.639287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.723353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679704b8-7182-4aa4-851d-b3bb41ced2a9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.763631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7479d8-23e9-4c2d-be59-e98d3c54aca8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.771747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.772440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.772720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.772992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.787732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:25.795673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:25.796786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 317/645] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:25.798433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.804117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.804832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.805148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.805386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.813893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.815112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.815358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:25.827894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:25.829159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 329/646] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:25.830467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.861960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:25.919289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ce1c2-dcfb-4b4b-b118-c5aa986e06e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.939212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa94e0c-218b-4e4b-92c8-c21338f8d748 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:25.957011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.957622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.957896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.958165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:25.958831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:25.959129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:25.960657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:25.969536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 318/647] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:25.970154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:25.978847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:25.979451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:25.979724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:25.980019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.057091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.062707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.064317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.084802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838948c7-80d7-4a97-aaf5-796b6a826108 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.098848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.120913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.121805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.122082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.122350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.123017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.123313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.124711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.134594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 319/648] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.135129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.178500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 330/649] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:26.179506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.242119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a7362-b232-48b2-a724-445d21ae4d0a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.279744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.280302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.280578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.280845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.281532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.281834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.283265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.285730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.288232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf625c-fe41-4f5d-825d-bc7ac62a4a88 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.297143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 320/650] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.298065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.327634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.335358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.336478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.336730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.337002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.347247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.348715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:26.364425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:26.365362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:26.366240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:26.366240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.366240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:26.366240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 331/651] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:26.366941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.408072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a410-036b-4c8f-971b-2011ca9f760d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.451518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119231-152d-422a-893c-dffc01530454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.452405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119231-152d-422a-893c-dffc01530454 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.452688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119231-152d-422a-893c-dffc01530454 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.452955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50119231-152d-422a-893c-dffc01530454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.466610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119231-152d-422a-893c-dffc01530454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.468103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50119231-152d-422a-893c-dffc01530454 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.468368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf227c0-19e0-4f06-88d3-ba47e3c79b2f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-50119231-152d-422a-893c-dffc01530454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:26.486848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:26.487824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:26.488863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:26.488863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.488863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:26.488863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 321/652] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:26.488863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119231-152d-422a-893c-dffc01530454 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.509507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.510284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.510937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.510937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.522465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.524127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.539452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:26.539758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:26.540879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:26.541950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:26.541950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:26.541950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:26.542436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 332/653] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:26.543216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.579899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.599706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50119231-152d-422a-893c-dffc01530454 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.632307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.633079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.633414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.633690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.634404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=ded8007ff9d64b5b809eef243b8d7895) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.634707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.636152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.651956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 322/654] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/role_assignments?user.id=ded8007ff9d64b5b809eef243b8d7895&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.651956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.662173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf059e-e3c7-410d-a344-137a6a545f16 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.706663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.707851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.708177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.708448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.709399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.709703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.711952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.730505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 333/655] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.735767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.776525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d846969-afe0-4572-9802-b264bccbc0d7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.791184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.821714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.822347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.822604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.823052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.823492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.823789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.825220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.838310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 323/656] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.838864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.867204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:26.877704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d639bd-bf58-451c-8d0f-bf63a81316ad None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:26.916605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:26.917322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:26.917598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:26.917880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:26.918508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:26.918807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:26.921046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:26.936633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 334/657] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:26.937982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:26.962576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd1100-477f-48de-bf76-a08df3a59c31 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.007294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.008030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.008307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.008575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.016684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.018143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:27.037557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:27.038748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 11:09:27.039894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:27.040541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 324/658] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:27.042722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.053641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04797b8-4b80-40d1-b83a-10af0387184e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.080485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.089517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.090278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.090648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.091007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.099101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.100682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:27.112529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:27.113693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:09:27.114849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:27.117982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 335/659] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:27.117982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.134243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.160425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011b46-2e66-4f10-ad8c-edd65bb04ddc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.196434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.197071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.197346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.197612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.204990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.206438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:27.218193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:27.219275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:27.220476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:27.224038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 325/660] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:27.224927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.225592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e819598-1175-4cc7-b1b1-f66f7adf3e0c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.261374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.262145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.262511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.262873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.263698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:27.264126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.265643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.284312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 336/661] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:27.285282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.328118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.338519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd21c-e1d8-48ab-93cc-36eb46d96194 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.356549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.375134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.376023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.376437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.376842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.377700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:27.378139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.379724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.389479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3dd6-2047-42eb-aa6a-311b8dd9ef03 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.398874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 326/662] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:27.400081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.425394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.426177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.426539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.426945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.427728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:27.428157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.429826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.447279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 337/663] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:27.447279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.513692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d44d8-e8b4-4996-be82-c5d69e97e90e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.545654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba39cf-3e2b-40fc-a080-3485ce93e93f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.548354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.548965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.549240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.549507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.567605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.580204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.586792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.587413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.587690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.587993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.619953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.621627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.660871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.662340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1767e-7edd-4a32-b81e-5a6631897486 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.730956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 327/664] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:27.730956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.779210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.785154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 338/665] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:27.790862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d093-7124-45d3-8fa2-cfa5334518e6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.790862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d093-7124-45d3-8fa2-cfa5334518e6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.790862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d093-7124-45d3-8fa2-cfa5334518e6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.790862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 339/666] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:27.790862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d093-7124-45d3-8fa2-cfa5334518e6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.823744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:27.843108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7246-4732-45bd-a955-d376b0a675dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.880918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a42840-6452-436c-bbac-7474170267fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.881526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42840-6452-436c-bbac-7474170267fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.881783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42840-6452-436c-bbac-7474170267fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.882067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a42840-6452-436c-bbac-7474170267fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.883235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a42840-6452-436c-bbac-7474170267fd None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:27.883810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a42840-6452-436c-bbac-7474170267fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.885899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a42840-6452-436c-bbac-7474170267fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.893085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 328/667] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:27.893791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a42840-6452-436c-bbac-7474170267fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:27.902299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d093-7124-45d3-8fa2-cfa5334518e6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:27.943842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:27.944978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.945464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.945938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:27.958605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:27.960769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a7bc532c-908b-4e50-b8a3-a35cfc1a6404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:27.977937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:27.978952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:27.979864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:27.979864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:27.979864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:27.982182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 340/668] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:27.983794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:27.984349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:27.984824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.004522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:28.006249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:28.012052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a42840-6452-436c-bbac-7474170267fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.028051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.056380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.057376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.057741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.058015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.072716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.074601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.088907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 341/669] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:28.089838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:28.090814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:28.091752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:28.091752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:28.091752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:28.091752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 329/670] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:28.092652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.096769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.113521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.215017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e76ed-3285-40bf-801a-b88b0674f172 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.226930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce7240-80e1-4b60-91a6-26e8583ae1e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.263337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.264227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.264643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.265073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.265857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.266296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.267277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.267995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.268174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.268589 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.268955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.269753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.270151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.271614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.287638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 330/672] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:28.287895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 342/672] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:28.290898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.291040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.327541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.385555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.411652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903791c0-4ea1-4259-82fd-1e550ef804ce None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.422939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2f2be-4351-481b-9042-93cbe5425a96 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.451653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.452900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.453615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.454034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.460207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.460953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.461296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.461630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.463121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.465325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.468965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.470465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:28.478289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:28.479362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:28.480506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:28.482565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 343/673] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:28.483569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:28.488233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:28.489091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:28.489950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:28.492358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 331/674] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:28.493291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.606637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3a639-a30f-477c-8a6c-cf6631f6faac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.607651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.625918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3d2a-09ac-4d62-8e46-22f4bd9c2b16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.645047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.646051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.646524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.646945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.649299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.660740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:28.666295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:28.667462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:28.668562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:28.669243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.669243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.669243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.669243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.669529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.669529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.670579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.671678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 344/675] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:28.672874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.688752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 332/676] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:28.689590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.781293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4e271-6007-4eb3-8111-f82dc3b660df None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.796657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e08b39-30c2-4569-aa63-097b9539a797 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.818351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.819393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.819994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.820387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.821193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.821685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.823321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.830484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.830761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.831035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.831693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.832023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.833372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5201e-bc4d-4e8e-b64a-8ab00d2fd509 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.841467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 345/677] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:28.841467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.845171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 333/678] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:28.849757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db45-e3e5-4dfe-a600-e6ddca72f002 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.849757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db45-e3e5-4dfe-a600-e6ddca72f002 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.849757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db45-e3e5-4dfe-a600-e6ddca72f002 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.849757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 334/679] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:28.849757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086db45-e3e5-4dfe-a600-e6ddca72f002 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.861232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.901896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:28.951497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5848f-e0d7-4e39-8107-d7f1347f1efb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.958908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086db45-e3e5-4dfe-a600-e6ddca72f002 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:28.986998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.987680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.988037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.988371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.989190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=4d42cfa2d2e9453d879c623cae849ed5) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:28.989494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:28.990910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:28.996822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 346/680] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/role_assignments?user.id=4d42cfa2d2e9453d879c623cae849ed5&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:28.997344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:28.997840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:28.998451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:28.998727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:28.998997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:28.999717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=41154775379d4f0da94e06f8f3fd1455) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:29.000054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.001513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cb428-8701-4bb4-bab2-a2303a44287a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.010392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 335/681] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/role_assignments?user.id=41154775379d4f0da94e06f8f3fd1455&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:29.011826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.012207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.012544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.033258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:29.034735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:29.111636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 336/682] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:29.145231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e224b-e758-4763-b717-ea0e18821441 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.166452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.191716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.192404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.192678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.192943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.216473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.217946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:29.233355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:29.234394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:29.235272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:29.235272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:29.235272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:29.235272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 347/683] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:29.240349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.243515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.355454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c056-55b8-44cf-86d7-743687da27fb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.393362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.393998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.394253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.394518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.395169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:29.395467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.396927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.409136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 337/684] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:29.414300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.434697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.514517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.527494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c360969-1637-4884-8528-ecd1c818ba2b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.558740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398c642-1af5-4ed5-8252-9d232efc277d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.561329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.562517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.562517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.562517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.570257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.571895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:29.583093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:29.584323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:29.585549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:29.588263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 348/685] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:29.590399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.599464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.600396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.600834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.601285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.613248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.614945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.628275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:29.637475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:29.638506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:29.639376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:29.639376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:29.639376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:29.639376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 338/686] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:29.644886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.693351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b4e5-5bda-4194-9917-6de33e7d7c3f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.733004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.733838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.734116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.734385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.735129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:29.735430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.737335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.762568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 349/687] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:29.764369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.860672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebac6-cacb-43e6-ba67-8739b1672a52 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.871230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa1f4-66fe-4772-bf42-e4e1557ea18b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:29.876301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.881030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:29.899582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.900321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.900667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.901008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.901767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:29.902161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.903623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:29.915300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:29.915946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:29.916244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:29.916512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:29.917195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 339/688] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:29.923253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:29.997519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:29.999177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:30.093707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:30.108018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 350/689] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:30.114329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249790a-5652-4ed3-8e15-aa849e88e193 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:30.117098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.181036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:30.181662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.181941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.182213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.182858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:30.185346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723c4b1-ed32-4573-90e6-1ea9c72bca92 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:30.222041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 340/690] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:09:29 2022] POST /identity/v3/users => generated 254 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:09:30.240402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bd30-3694-4908-969e-a8ea343fe2d2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.240720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bd30-3694-4908-969e-a8ea343fe2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.240955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bd30-3694-4908-969e-a8ea343fe2d2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.242811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 341/691] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:30.248263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.248570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.248807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.270121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e494a65-47a7-4e79-b391-83e8a9a5c768 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:30.287349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:30.289003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:30.347790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:30.350349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:30.351531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.351938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.352132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.379632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:30.381134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:30.405113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:30.406113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:30.407098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:30.407098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:30.407098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:30.407673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 351/692] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:30.415191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.418279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 342/693] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:30.463484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:30.525702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8307c-0c2b-43c7-a963-725b11077d69 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:30.565832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:30.566458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.566738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.567007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.567665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:30.567997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:30.569382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:30.587846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 352/694] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:30.592627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.705070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.718293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a31c3-a6e7-41ea-97c7-0ce72dc8fc8a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:30.800639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:30.801617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.802118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.802590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.810292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:30.812008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:30.819139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f508e-d3b2-45ed-92e8-80748546e7ce None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:30.837885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:30.838850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:30.839741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:30.840225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:30.845732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 343/695] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:30.857574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.860404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:30.861153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:30.861528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:30.861895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:30.875941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:30.877895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:30.879077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:30.880149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:30.887948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 353/696] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:30.887948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:30.907569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:30.988617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959fe0-e551-452c-b7af-6fc674c84b2d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.027521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.028176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.028453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.028722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.029402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:31.029700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.031068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.048833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 354/697] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:31.060094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc0bbf-45e8-4c1e-a3db-7557fa4a7e11 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.063078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.104276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:31.130390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.131016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.131296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.131569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.132431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:31.132740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.135281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.161621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 344/698] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:31.164005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.249652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fecc4-0049-49b9-9723-d0614e60f791 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.312298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:31.314284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.315166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.315166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.315440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.339376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.340868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.349739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35b14-6453-46e7-ba3a-b873d3f2514b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:31.370325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:31.371325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:31.372279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:31.372279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:31.372279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:31.377741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 355/699] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:31.378578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.437196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.438181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.438679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.439146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.440120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=89e54d17894648ff81de2b23119732fa) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:31.440678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.442417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8e7e-a8a3-41e9-8c35-590be9ad5284 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.457059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 345/700] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/role_assignments?user.id=89e54d17894648ff81de2b23119732fa&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:31.469635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:31.497670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105284d-ee8a-46d0-a30a-6bfcc91aadd5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.517733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2905-7580-4a15-9289-3383d4f8b05d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.517939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2905-7580-4a15-9289-3383d4f8b05d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.518191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c2905-7580-4a15-9289-3383d4f8b05d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.519793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 346/701] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:31.525134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.525357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.525640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.536273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.537173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.537606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.538014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.538873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:31.539357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.541818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.545573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:31.546775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:31.559178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 356/702] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:31.565193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.686860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb11b-d84e-4e2c-9142-37e0768dc854 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.688280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 347/703] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 11:09:31.722402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.723608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.724061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.724488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.728296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:31.736822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.740312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ee6f2b7e-a292-415e-a6ee-04c87c924332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:31.754088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:31.755358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:31.756558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 357/704] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:31.761378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.785508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a389-6769-425f-9a75-f8de0f370e37 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.785714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a389-6769-425f-9a75-f8de0f370e37 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.785986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a389-6769-425f-9a75-f8de0f370e37 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.787317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 358/705] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:31.792769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.793040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.793304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.815759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:31.817412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:31.853565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:31.884516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409467e-8a0c-44f2-b42b-83f6db979cf9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:31.908520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 359/706] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:31.926950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:31.927777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:31.928234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:31.928653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:31.929606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:31.930056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:31.931624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:31.950639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 348/707] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:31.956440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:31.985140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.071149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5c0aa-0d7c-4b9f-bec8-82af18473832 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.098624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.106489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca62-9d19-41fd-8b31-6b6716adae4d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.111212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.112034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.112455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.112862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.142843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.149413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d6765-8046-4acb-b683-c819f683063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.150751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6765-8046-4acb-b683-c819f683063e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.151028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6765-8046-4acb-b683-c819f683063e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.151297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d6765-8046-4acb-b683-c819f683063e None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.152440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d6765-8046-4acb-b683-c819f683063e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.153391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d6765-8046-4acb-b683-c819f683063e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-166d6765-8046-4acb-b683-c819f683063e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:32.165743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:32.166998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:32.168037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 349/708] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:32.173171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d6765-8046-4acb-b683-c819f683063e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.190174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.191853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.290732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d6765-8046-4acb-b683-c819f683063e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.293451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 360/709] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:32.299138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.328112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.336633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.337392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.337676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.337951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.338599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] RBAC: Adding query filter params (name=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:32.338904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.340642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.352157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 350/710] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:32.353082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.414456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c564f-03bb-40bd-9c87-5953324ef844 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.432800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.454529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.455516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.456045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.456659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.457460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.459249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:32.471770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:32.472872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:32.473749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:32.477847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 361/711] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:32.478926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.480703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109fe1e-7b1e-496a-899f-432e686efc2a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.517066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.518252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.519013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.519746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.533695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.536226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:32.554889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:32.556053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:32.556944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:32.556944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:32.556944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:32.563228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 351/712] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:32.563228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.597360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.612792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76366-0d64-4a62-bbcf-3655ce30acb1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.655835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.656483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.656766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.657038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.657678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:32.657980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.659376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.665935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 362/713] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:32.666736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.696626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5add-7cde-4298-a5b0-f87034b7c87d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.712631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.744468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.745710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.746199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.746990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.747825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:32.748355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.750537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b53c8-bba7-4f94-9031-e89425e3ee82 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.757700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 352/714] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:32.759993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8faa3d-7a6a-4999-9888-19025e907dee None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.760459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8faa3d-7a6a-4999-9888-19025e907dee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.761045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8faa3d-7a6a-4999-9888-19025e907dee None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.763343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 353/715] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:32.764300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8faa3d-7a6a-4999-9888-19025e907dee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.808164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac1af-fc56-4f96-a5b7-a4b0730c41b3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.852028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.852610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.852886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.853147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.853807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:32.854100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.855460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131941-4788-4ce0-b9dc-703b28a2c045 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.873193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 363/716] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:32.873193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.873193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.873193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.889109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:32.890387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:32.898269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:32.914720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8faa3d-7a6a-4999-9888-19025e907dee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:32.955048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:32.956047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:32.956550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:32.957009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:32.957844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:32.958349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:32.959902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:32.963111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 364/717] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:32.964115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:32.968473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 354/718] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:33.080038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3eaf1b-7fe9-48ad-9366-dc8ff0eaf9c5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.126436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.127008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.127434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.127539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.142202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:33.143681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:33.158997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:33.159991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:33.160879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 365/719] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:33.167889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:33.248293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:33.330738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69157ab3-fac4-4d16-8c81-2eb8abbf0c31 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.352797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:33.360853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:33.375706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.376389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.376716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.376980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.377670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:33.377971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:33.379872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:33.394330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 355/720] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:33.400272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:33.531895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b0adb-ad78-4e4d-b3e0-3d989ef4e387 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.561187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:33.564111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a726e-21c3-4233-a34d-55e0ae37fcf3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.570832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.571767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.572279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.572772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.584071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:33.589621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:33.590566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:33.591418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:33.594140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 366/721] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:33.611936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:33.632212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.632918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.633198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.633472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.634227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:33.634506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:33.635956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:33.646961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 356/722] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:33.694990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:33.741274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee73d99-97ea-49d5-a922-e77e127cb0d6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.779538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.780203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.780483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.780752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.781428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:33.781730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:33.783131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:33.796112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 367/723] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:33.799039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:33.909742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f3a4d-43a9-4a27-9c3a-6f91d133989d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:33.945915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:33.946556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:33.946835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:33.947105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:33.958717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:33.960412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5c08ad43-7438-4b86-81f9-86ef626817f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:33.975238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:33.976281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:33.977233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:33.977233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:33.977233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:33.980953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 357/724] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:33.982802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:34.077213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a91b-e80a-4f65-9190-f9687df23921 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.077540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a91b-e80a-4f65-9190-f9687df23921 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.077748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505a91b-e80a-4f65-9190-f9687df23921 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.079356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 358/725] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:34.095948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.096241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.096516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.114416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9244885-9978-4850-896c-f9e19de2b5aa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:34.131147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:34.132578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:34.139868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:34.150690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:34.152189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.152943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.153621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.153841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:34.154818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:34.155328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:34.157485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:34.179412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 368/726] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:34.183290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:34.259808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 359/727] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:34.350784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70c37b-281c-4d5f-9a45-855c6661cf03 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:34.394027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:34.394667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.394942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.395208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.407157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:34.408629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:34.422803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:34.423790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:34.424769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 369/728] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:09:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:34.429902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:34.569841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7d108-6456-4a7c-bbfe-f0a41f452efa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:34.613977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:34.614912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.615368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.615857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.616840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:34.617372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:34.619039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:34.645291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 360/729] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:09:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:34.649922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:34.651361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:34.656935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:34.723586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:34.806199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779b31-6ef7-45cc-99ce-b34659a0c4dd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:34.831603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6771a8-7bbd-4e45-a470-7d0826125bed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:34.842101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:34.842723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.843002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.843279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.912652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:34.913402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:34.913677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:34.913963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:34.915604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:34.917126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03eeb0-62cf-43cb-ba6d-0e7dcc6d3642 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:34.920272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:34.934012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:34.942502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:34.943443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:34.944448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:34.947289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 370/730] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:34.953343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.043289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 361/731] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 11:09:35.045164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf70-5e87-42d5-80bb-0d4e33c4845f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.045452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf70-5e87-42d5-80bb-0d4e33c4845f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.045726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf70-5e87-42d5-80bb-0d4e33c4845f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.051497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 362/732] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:35.052337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaedf70-5e87-42d5-80bb-0d4e33c4845f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.080656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc065-d16d-430f-8708-5af54ef11c37 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.084766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.122873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.123479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.123815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.124122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.124846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:35.125150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.126537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b417bb4-7073-4ce7-82d3-c8e8fb3ac9cd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.135848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 371/733] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:35.137271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.137557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.137859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.157443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:35.158694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:35.171297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaedf70-5e87-42d5-80bb-0d4e33c4845f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.182605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.210456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.211101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.211386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.211661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.222782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.224401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.236010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 372/734] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:35.236929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:35.240078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:35.241122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:35.242028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:35.242028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:35.242028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:35.242028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 363/735] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:35.247747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.358846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195282d-0452-4396-adfa-8a3d4db32d03 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.359127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.365828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea55cf3-d432-4833-811b-1d80f5e7aa92 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.399177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.400171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.400797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.401238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.401961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.402235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:35.402690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.402802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.403085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.403432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.404674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625377d4-aa9b-4c8b-957b-2dcc7eb6ec97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.414917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.416249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.421269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 364/736] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:35.427021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd84d-7413-4be3-ad49-95b3e67f5790 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.427759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd84d-7413-4be3-ad49-95b3e67f5790 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.427973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd84d-7413-4be3-ad49-95b3e67f5790 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.429791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 365/737] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:35.431952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd84d-7413-4be3-ad49-95b3e67f5790 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d7948d7b-7e42-4631-9a7f-ae7ed714fd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:35.444564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:35.445541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:35.446444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:35.446444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:35.446444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:35.448500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 373/738] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:35.450710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.451450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.452075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.456881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.478613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:35.480083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:35.552411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd84d-7413-4be3-ad49-95b3e67f5790 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.560550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 374/739] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 11:09:35.562063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.588758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.589338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.589614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.589878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.597623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.599085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.659909 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.685310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35379af0-67dd-4951-b563-a9c167aed9c8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.724127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.725125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.725644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.726116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.727119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:35.727631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.729276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:35.736076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:35.737025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:35.737916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:35.742403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 366/740] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:35.743632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.746016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 375/741] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:35.748015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.834134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:35.858806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106da6a-39b1-4725-999b-578773dab0a5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.881983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70732ea-7d89-4740-a8bd-23ebdc0856e4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:35.895197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.895802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.896112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.896405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.897065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.898641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.924195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 367/742] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:09:35 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:35.926447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.930768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:35.931629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:35.932048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:35.932247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:35.932937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:35.933303 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:35.935838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:35.952078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 376/743] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:35.953396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:35.956874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.074573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915de840-2597-470c-8cf3-ff16a4ece3d2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.078094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d6ea8-85f1-4fcb-b00f-e591a587c84f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.119070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.119748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.120055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.120210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.120822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.120998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.120998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.121244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.121876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:36.123289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:36.124169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.130938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:36.133502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:36.141322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 377/744] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:09:35 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:36.141322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-26b3107a-4579-4061-859f-8f85e11cb9ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:36.157226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:36.158243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:36.159262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:36.159788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 368/745] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:36.161286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0476d6-0183-4c56-9dc0-c6c7f03be41c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.161570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0476d6-0183-4c56-9dc0-c6c7f03be41c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.161843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0476d6-0183-4c56-9dc0-c6c7f03be41c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.167459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 369/746] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:36.168963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.169253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.169841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.189078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:36.190216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:36.226821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.271976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 370/747] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:36.271976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.313858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3187-102d-4534-9195-fbbac673cc04 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.354109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.355071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.355533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.356045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.356895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=b0163816d4024a9c81548f4eb0555bfe) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:36.357291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:36.358830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:36.365871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 378/748] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/role_assignments?user.id=b0163816d4024a9c81548f4eb0555bfe&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:36.420597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e0465-7635-4ae8-9e86-37c2844e938a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.449597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.462860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.463490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.463767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.464074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.464818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:36.465121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:36.466651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:36.491075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 371/749] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:36.494606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.579454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.602628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b9359-18aa-433c-b49d-afdce82f8667 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.622240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.643220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.643881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.644190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.644462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.748869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:36.750019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:36.791975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff845b-5776-47a3-9a4d-1888186e5b8a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:36.859317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:36.860003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:36.860239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:36.860502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:36.883271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:36.887976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:36.888910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:36.889762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:36.896071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 372/750] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:36.896937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.935111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 379/751] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:09:36.951613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:36.967941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:36.988300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:37.082083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545a0e8-87e1-44bd-94e6-dd365f40f38f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.125278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863576-ca3b-402f-81d5-f05ed0a1635b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.151511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.152363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.152642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.152912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.153584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:37.153880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.155255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.164132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 373/752] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:37.174055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.178958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.179593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.179862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.180152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.199030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.200574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:37.215751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:37.216732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:37.217647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:37.217647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:37.217647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:37.217647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 380/753] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:37.222627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.308286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:37.339171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde981f9-0e22-4701-9a5b-90f2c49dd3a3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.405847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.406880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.408054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.409074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.409945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:37.410621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.412690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd659d-1a4c-4761-bd43-8854624633ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.414342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.424250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:37.438416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 381/754] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:37.447962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.489553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.490192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.490472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.490740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.506179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.507744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:37.532313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:37.533321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:37.534229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:37.534229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:37.534229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:37.542862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 374/755] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:37.549441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.601289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2eb23-69a4-4782-8d64-98cd6aca2598 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.631844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:37.643727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.644802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.645380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.645863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.659823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.662622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:37.679502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:37.680482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:37.681374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:37.689025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 382/756] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:37.694873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.738109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4517837-1d24-43a4-8a7d-c91f89c119a1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.811716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.812358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.812636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.812904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.813554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:37.813857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.815243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.838392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 375/757] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:37.843418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.855561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9126b-ab29-428b-a1d7-e76d74a57cc1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:37.876306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:37.893662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:37.894588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:37.894873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:37.895152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:37.895859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:37.896214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:37.898074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:37.911710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 383/758] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:37.917745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:37.977438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:38.033916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880276e2-6a2c-4ae9-9151-ee6b7c6f7107 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.072083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.072759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.073041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.073310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.074098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=89e54d17894648ff81de2b23119732fa) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:38.074403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.075859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d98-c656-487b-b19d-3cc84eaaeed1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.081302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4627c-8558-4dc5-bbce-a19695584031 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.081714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 384/759] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/role_assignments?user.id=89e54d17894648ff81de2b23119732fa&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:38.082904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9666-b1fe-4bb1-838c-9e8d1ba3e803 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.083189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9666-b1fe-4bb1-838c-9e8d1ba3e803 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.083463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c9666-b1fe-4bb1-838c-9e8d1ba3e803 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.097306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 385/760] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:38.103545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.104072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.104539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.126082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:38.127201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:38.134305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.134995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.135254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.135592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.150349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.152077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:38.171306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:38.172403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:38.173353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:38.176190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 376/761] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:38.185372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.261965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 386/762] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:38.304329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:38.353773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df96cc-6574-4941-b0f0-8eaf6131d957 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.403407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.404047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.404329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.404598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.405326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:38.405626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.407061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.433899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 377/763] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:38.439542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.500972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:38.536325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.560399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44e884-853e-4554-b8c4-450ab7a5ba06 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.616741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.617534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.617872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.618226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.629034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.630570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-858e11e5-686c-4473-948e-2148b12f333a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:38.646095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:38.647176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:38.648142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:38.648142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:38.648142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:38.648142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 387/764] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:38.651695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7368-4884-4fb1-8640-af60f0706fdb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.652008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7368-4884-4fb1-8640-af60f0706fdb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.652295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7368-4884-4fb1-8640-af60f0706fdb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.653803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 388/765] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:38.654312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7368-4884-4fb1-8640-af60f0706fdb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.685111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3539924-1898-40a9-8485-daeccdfd102b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.717110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:38.724776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.726133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.726410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.726681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.727273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.728682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-00198aa7-8c5f-4235-ac71-832364376cfa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:38.737968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:38.738975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:38.739881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 378/766] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:38.741547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.741547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.741547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.760431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:38.761613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:38.772251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:38.779720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7368-4884-4fb1-8640-af60f0706fdb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.814318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.814927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.815209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.815462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.816163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:38.816447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.817798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e36a88-2581-4906-9e24-c44a8b682b3e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:38.830240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 389/767] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:38.831679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8371-b2e5-42d0-aa53-62fcb8e7ace3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.832216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8371-b2e5-42d0-aa53-62fcb8e7ace3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.832730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa8371-b2e5-42d0-aa53-62fcb8e7ace3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.834364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 390/768] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:38.835494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa8371-b2e5-42d0-aa53-62fcb8e7ace3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.842135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 379/769] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:38.842988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:38.948989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa8371-b2e5-42d0-aa53-62fcb8e7ace3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.969025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d76d-c982-40d8-bc5c-b74ba8b839eb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:38.992388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:38.993004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:38.993275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:38.993542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:38.994283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] RBAC: Adding query filter params (name=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:38.994583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:38.996118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acefbc-3c8e-4abd-9532-71e3f8966d47 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.001325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 391/770] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.002573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.002854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.003126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.009856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.021161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.021976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.022484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.022758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.026808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:39.028150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:39.029925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.032665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.045035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:39.048287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:39.049190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:39.050144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:39.050575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 380/771] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:39.053908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.171076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c88a60-18c8-4245-9774-f82aba180dc2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.206762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.207270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.207543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.207807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.208469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:39.208764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.210364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.220223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 381/772] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.220223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.243954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 392/773] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:39.243954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.293814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.357255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b1e13-e3a1-4c4d-b938-5a7807bfa5eb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.360376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1dcf-bc7e-42de-bd8d-3424008f6d6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.399696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.400355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.400631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.400899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.401476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.402827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.409933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.410538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.410811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.411079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.411764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:39.412087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.416365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:39.418426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:39.419742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:39.420610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 393/774] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:39.421418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.436572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 382/775] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.437672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.441628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.537502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a82407-ae5d-4b20-82d1-78cd38352677 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.564602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfc43-df1c-4a8a-8756-f79c703aa0c8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.572567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.573197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.573474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.573738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.574444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] RBAC: Adding query filter params (interface=public, service_id=4dc445a64b3b407983fbdbeddf3f41f4, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:39.574744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.576116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.577441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.588564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 394/776] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/endpoints?service_id=4dc445a64b3b407983fbdbeddf3f41f4&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.588564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.607700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.608445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.609089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.609089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.609709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:39.610015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.611418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.620085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 383/777] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.620085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.670581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.692015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09eda-d04a-4b1d-a86c-9a55265db71e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.728379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.729906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.730383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.731066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.734336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf029cf-a9b7-444d-b3a0-6dee022d32df None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.735078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=991c9767714849039e301854775dac09, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.736674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.764049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 395/778] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:39 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:39.765436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.778472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.779435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.779856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.780544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.794794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:39.800391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:39.801407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:39.802252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:39.810399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 384/779] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:39.811726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.854115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.905324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aaa840-8de5-447c-bd45-47e6071b3b2d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.940246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a82c3-4413-4d65-a183-cf5a8835928f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:39.941322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.941943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.942222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.942497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.943134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.945300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:39.950276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 396/780] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:39.951087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:39.958099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:39.986370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:39.988963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:39.989477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:39.989974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:39.990989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:39.991559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:39.995223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.011959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 385/781] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:40.017750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.116517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adaeb6-0628-4372-87e4-e908bf793af4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.160359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.161026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.161304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.161566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.162240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:40.162559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.164383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0948d9-6761-42b2-be2b-9fcef8e5a255 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.177031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 397/782] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:40.178409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfd5a-d759-475f-bd4d-de76a8d824f2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.178689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfd5a-d759-475f-bd4d-de76a8d824f2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.179029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfd5a-d759-475f-bd4d-de76a8d824f2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.180563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 398/783] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:40.184555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bfd5a-d759-475f-bd4d-de76a8d824f2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.232615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:40.238444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c358262-a72a-4dcb-bf71-d3857ad15e17 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.264073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:40.284705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.285634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.285819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.286091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.286892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] RBAC: Adding query filter params (interface=public, service_id=410dc6b22ccf4ec89be859cf3f17be04, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:40.287194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.289363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ce4d-1438-4672-9ae0-d8e5db26bc13 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.298754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 386/784] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/endpoints?service_id=410dc6b22ccf4ec89be859cf3f17be04&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:40.304887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.304887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.304887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.322405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bfd5a-d759-475f-bd4d-de76a8d824f2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.326001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:40.327213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:40.362950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.363606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.364254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.364484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.379532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.381170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:40.396830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:40.398774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:40.402782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:40.402782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:40.402782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:40.411047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 399/786] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:40.412404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.416310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 387/786] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:40.417236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.547694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86421853-3c08-4fc3-9ebe-db70f1a4d2ef None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.572870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:40.594344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.595244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.595669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.596122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.596914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.598631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.604774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 400/787] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:40.613588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:40.627893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae896-aad2-429b-bff0-86a2b07a1d77 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.693252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.694565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.695056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.695492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.696356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:40.696813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.698425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.717964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 388/788] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:40.728615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.829118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:40.900581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd269e8b-4492-4b5d-8682-d662050e8b3c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.946056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:40.946743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:40.947016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:40.947283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:40.957712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:40.959265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:40.973308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:40.974320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:40.975530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:40.976162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 401/789] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:40.980656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3de8-fcef-4125-940d-a901f0b9c552 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:40.984025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.031526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.032509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.033301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.033579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.041057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:41.052083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:41.059564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:41.060717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:41.061625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 389/790] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:41.069063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.104730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:41.171077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75874fd-87f3-4fe9-a86c-6c9bd6644491 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.203062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd01f5-4da0-496c-8ee2-c0d4bf0a96b9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.242407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.243023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.243299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.243567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.244263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:41.244560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.245938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.255603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 390/791] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:41.261237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.293433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.294016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.294588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.294856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.295984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:41.296302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.298013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.333848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 402/792] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:09:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:41.342262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.394746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:41.433263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fffe19-9c66-4537-8a6c-59b5043b7901 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.469472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.470381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.470661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.470933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.482857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.484684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:41.500385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:41.501362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:41.502237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:41.502237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:41.502237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:41.502237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 391/793] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:41.508039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.602568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:41.617842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870df29-44c4-4746-be07-310ad5ca2fce None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.643068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5774-12a9-4d92-988e-7b17f70c6ae1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.676285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:41.681500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.682120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.682397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.682661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.683305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:41.683602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.685136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.698169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 392/794] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:41.703517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.708637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.709323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.709633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.709906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.726456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.727836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:41.752239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:41.753433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:41.754544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:41.754544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:41.754544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:41.754544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 403/795] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:41.760948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.867783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b413f-8815-4f43-9ccc-79989647b8d1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.911518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.912307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.912804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.913241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.916096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109acce-8632-42c0-b68d-b4401e7d19e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:41.921128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.922837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:41.935796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:41.936820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:41.937753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:41.940012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 393/796] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:41.946002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.951314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:41.951967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:41.952257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:41.952532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:41.953189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:41.953496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:41.954870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:41.970261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 404/797] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:41.977229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:41.992316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.034564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.081302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c420b75-31db-477f-886b-4b4e0f432d22 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.121128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.121766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.122039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.122305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.132996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.134442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.139559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8683c-500b-46df-b802-45b382ec0174 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:42.158594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:42.159548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:42.160466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 405/798] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:42.168719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.216154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.216969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.217254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.217522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.218832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:42.219150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.220756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9fc41-e1a7-4b61-a06b-68dd635cc2fa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.243951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 394/799] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:42.245141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500f58-6360-4d38-8ff5-29732b9ac120 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.245420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500f58-6360-4d38-8ff5-29732b9ac120 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.245689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77500f58-6360-4d38-8ff5-29732b9ac120 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.247551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 395/800] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:42.249638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77500f58-6360-4d38-8ff5-29732b9ac120 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.270077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.305057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae1a9a-5748-4f22-a9cf-a4f72339cb77 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.341572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.342409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.342519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.342782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.343532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:42.343844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.345338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b398ab-8a78-4407-8245-84a43286eb69 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.362583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 406/801] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:42.362583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.362583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.362583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.372254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77500f58-6360-4d38-8ff5-29732b9ac120 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.375409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.379708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:42.380943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:42.410567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.411343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.411683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.412044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.423052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.424532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a0b3d5a0-af4e-43bf-8e26-fc0c18f1ea58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:42.439848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:42.440951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:42.441828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:42.441828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:42.441828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:42.441828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 396/802] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:42.442447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f68bb-0f34-49ac-9da0-0f4c2755b28b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.442544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f68bb-0f34-49ac-9da0-0f4c2755b28b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.442987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f68bb-0f34-49ac-9da0-0f4c2755b28b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.448355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 397/803] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:42.449245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f68bb-0f34-49ac-9da0-0f4c2755b28b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.460389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 407/804] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:42.460389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.515595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.558420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aadafc-f2ef-4b8f-bd33-1540561cac90 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.563437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f68bb-0f34-49ac-9da0-0f4c2755b28b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.592696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.593618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.593898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.594186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.595062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:42.595363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.597241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8db0ee-958f-4434-86d9-1665e2bb26c5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.602039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.602906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.603354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.603803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/b0163816d4024a9c81548f4eb0555bfe/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.609817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 408/805] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:42.616084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.616770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.617209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.623533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=b0163816d4024a9c81548f4eb0555bfe, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.626123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.637467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:42.639055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:42.644136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 398/806] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:42 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/b0163816d4024a9c81548f4eb0555bfe/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:42.645261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.661785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.772861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 409/807] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:42.779944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.814074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c5483-aaef-43cd-881a-51d3512ef139 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:42.861847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:42.862652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:42.862991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:42.863273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:42.872561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:42.874026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:42.888255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:42.889216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:42.890131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 399/808] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:42.896756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:42.911349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.969394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:42.987315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511135-e76b-4625-963e-e6038d43ccee None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.008434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4c7f6-b3ae-4a76-8640-13cb936faca7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.030427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.031496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.031771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.032217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.045708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:43.046145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.046824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.047166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.047501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.048322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:43.048692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.050189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ed35-d609-49bd-8ba6-dbeedb8a415c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-61a3a260-9933-44ef-ad45-8df1617d5972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:43.050371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:43.051348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.052228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 410/809] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:43.053394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260695-36e9-4264-94d5-b16a8778ca69 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.053394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260695-36e9-4264-94d5-b16a8778ca69 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.053847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f260695-36e9-4264-94d5-b16a8778ca69 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.059209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 411/810] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:43.060093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f260695-36e9-4264-94d5-b16a8778ca69 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.076641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 400/811] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:43.078250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.078601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.078943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.099704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:43.101387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:43.173734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 401/812] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:43.174695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.176515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f260695-36e9-4264-94d5-b16a8778ca69 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.192229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.222636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.223340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.223680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.224041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.225346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:43.225717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.227598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.241564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 412/813] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:43.243575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.250495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.301173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129ee7-4930-448b-806e-b6e954392caf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.344243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.345042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.345324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.345592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/89e54d17894648ff81de2b23119732fa/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.347803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=89e54d17894648ff81de2b23119732fa, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.349951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.364689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62752be-811d-4797-9588-8ee77ffc1b3c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.371988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 402/814] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:43 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/89e54d17894648ff81de2b23119732fa/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:43.371988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.445609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.446438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.446813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.447181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] PATH_INFO: `/v3/services/network` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.448607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.450114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:43.465830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:43.467714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.468745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 413/815] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:43.470457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.516794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.521738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d52b5-d1b6-46d6-adb1-5e636e397955 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.541541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.568300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.569486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.569972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.570471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.586468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.587966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.601138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51359d87-40b5-4b20-988c-21e7d42ca839 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:43.603302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:43.604272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:43.605170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:43.605170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:43.605170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:43.605170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 403/816] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:43.605825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.651559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.652600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.653587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.654086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.655262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.657064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:43.670221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:43.671472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 11:09:43.672486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:43.675486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 414/817] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:43.676496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.729189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfc961-fa88-4c81-a90e-c3141a59c07d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.765507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.766400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.766873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.767330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.768175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] RBAC: Adding query filter params (name=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:43.768622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.770146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.775394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 404/818] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:43.776617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.799395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.802420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790fb8c-03cb-428b-b49e-9c1431e7af2b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.816026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:43.841023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.841767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.842196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.842561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.843762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:43.843762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.845452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.860055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 415/819] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:43.860937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.897845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b70c15-2809-4979-8551-bbf597676207 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:43.935483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:43.936397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:43.936936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:43.937401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:43.938251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:43.938721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:43.940321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:43.946058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 405/820] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:43.947192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:43.977135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81e99e-5299-41c2-81e1-9b493c9dfbab None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.012307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.013040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.013414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.013779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.014609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] RBAC: Adding query filter params (type=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:44.015008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.016649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.022822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 416/821] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:44.023842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.050564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.053778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.061555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641beab-7316-420f-be38-eda8e17ee407 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.099613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.100761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.101315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.101784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.110272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.112101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:44.124718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:44.125690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:09:44.126649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:44.129520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 406/822] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:09:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:44.130591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.136369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2321c-ad9c-4ed2-a803-1f13a0d8b59d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.172687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.173304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.173577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.173842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.174473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:44.174772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.176154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.181607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 417/823] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 17 11:09:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:44.182413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.248645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd6764-dd5b-49fc-94c4-91eb0a1dde70 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.272888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.285910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893ec1-01d7-4b74-aa39-694f28bb77a7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.288456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.289414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.289994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.290495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.291351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.293019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.318485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 407/824] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:09:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:44.320070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.330663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.331632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.331632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.331947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.332733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:44.333086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.334957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.339856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.360826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 418/825] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:09:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:44.366253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.448666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960982b-f967-4eb5-9009-0dd19b109824 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.492763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.493777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.494259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.494731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.495617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.497263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f10de5-1f12-4143-a516-69cea4fe9aef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.524520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 408/826] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:09:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:44.552022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c351af1-24de-44ef-9382-fe7842b09438 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.598578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.599594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.600221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.600696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.615608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.677918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.679561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:44.753375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f40b-147c-4703-8f79-4e6cc40961aa None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.753795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f40b-147c-4703-8f79-4e6cc40961aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.754200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f40b-147c-4703-8f79-4e6cc40961aa None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.755890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 409/827] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:44.763597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.763849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.764247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.786482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:44.787781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:44.805799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 419/828] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:09:44.811078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:44.855178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.873326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:44.882961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 410/829] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:44.931321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3333b-bab8-40fe-98b8-9d21a1c56606 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:44.971044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:44.971982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:44.972400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:44.972856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:44.983667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:44.985371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:45.000631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:45.001756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:45.002841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:45.002841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:45.002841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:45.004559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 420/830] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:45.012416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.113444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecab4f-1c1a-453b-ba1b-91f8c6a9f15a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.149736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.150646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.151071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.151493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.152315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:45.152755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.154264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.167340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 411/831] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:45.173011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.173174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.253293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.284181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.298394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbdc06-768b-4c98-a932-63988912f560 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.299048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb81f-92c4-43e8-824b-7f8887aff207 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.332928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.333556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.333833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.334174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.341148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.342592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.344093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.344963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.345434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.345898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:45.354604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:45.355528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:45.356483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:45.359867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:45.360565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 412/832] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:45.361400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:45.366429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:45.367705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:09:45.368861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:45.371246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 421/833] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:45.376826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.480392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621afc-4897-451c-bec4-41ddbb7d02cf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.501286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.502444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7d9fc-574e-4325-823f-f7d8cf27eb0d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.519350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.519989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.520270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.520542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.521233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:45.521568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.523088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b39ce-c9c7-4a70-9b66-d2c0790458e7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.535371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 413/834] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:45.536650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9d7b-5384-4e6b-a0bf-affb78030cf6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.536935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9d7b-5384-4e6b-a0bf-affb78030cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.537339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e9d7b-5384-4e6b-a0bf-affb78030cf6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.539956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 414/835] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:45.541435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e9d7b-5384-4e6b-a0bf-affb78030cf6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.546864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.547477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.547750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.548046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.548711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:45.549007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.550354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cc7fa-fb2e-4386-8891-bd96fafcb8aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.559556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 422/836] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:45.560792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.561052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.561356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.581463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:45.582655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:45.590691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.654635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e9d7b-5384-4e6b-a0bf-affb78030cf6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.663995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 423/837] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:45.663995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.692552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.693264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.693701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.694216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.694642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:45.694995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.696524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.707954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 415/838] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:45.789980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a190d-f5f6-460a-95c2-2d6644b0fa6e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:45.827561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:45.828229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:45.828502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:45.828769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:45.840472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:45.841936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:45.843827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:45.859784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:45.860829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:45.861723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:45.861723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:45.861723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:45.861723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 424/839] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:45.868837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.914956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:45.959463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:45.980256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d56e28-25eb-40ac-9c7c-ec894662b6ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.026106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.027101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.027591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.028150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.029013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:46.029525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.031182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.046642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 416/840] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:46.052553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.100590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e5a2-5ce8-4881-addf-56967061d031 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.141673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.142708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.143257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.143776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.157969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:46.165317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:46.166375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:09:46.167233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:46.170258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 425/841] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:46.171350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119799-2bc7-4529-9356-1530a6a04421 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.180017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.180182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.218844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.219494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.220141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.220430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.229977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.231441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.237178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:46.248773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:46.249942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:46.251114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:46.253546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 417/842] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:46.263968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.292496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e785966-46b6-48b8-a18a-e59184b7c9c1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.336572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.337229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.337513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.337787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.338466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:46.338778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.341374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.356238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 426/843] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:46.362484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.382890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2282b-ae3b-47e8-86ad-56fcc8c423f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.422802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.423870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.424390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.424854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.425888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:46.426462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.428177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.450922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 418/844] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:46.457177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.474911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8634-5fe9-42b5-ba1b-790595729b79 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.485975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.500240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.522229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.523282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.523784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.524278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.534932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.536683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:46.552252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:46.553387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:46.554602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:46.554602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:46.554602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:46.560563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 427/845] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:46.561956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.588307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea2ae-d90d-4593-9df9-00d47529c864 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.626897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.627505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.627800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.628145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.667456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a376c60-fe21-4371-a91b-90d762a35738 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.701484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.702891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.703046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771f0d2-8a03-4469-adeb-5da38a1f28f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.703501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.703773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.704073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.704749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:46.705048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.706386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cd83-a16d-4d9b-a59d-1a6f8b88578f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.723504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 428/846] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:46.723504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81834-2565-46ce-b8bf-5d4c017093dc None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.723504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81834-2565-46ce-b8bf-5d4c017093dc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.723504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81834-2565-46ce-b8bf-5d4c017093dc None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.723504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 429/847] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:46.726826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81834-2565-46ce-b8bf-5d4c017093dc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.736026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.758759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:46.821932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 419/848] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:09:46.823129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.823414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.823688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.843122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:46.844351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:46.844851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81834-2565-46ce-b8bf-5d4c017093dc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:46.882410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:46.883049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:46.883322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:46.883590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:46.891054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:46.892533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:46.905733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:46.906948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 11:09:46.908126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:46.911787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 430/849] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:46.912813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.927972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 420/850] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:46.927972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:46.991477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.007082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.019779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60b4f-e3a5-414b-b39f-1ec338e1fcef None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.059600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.060268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.060549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.060821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.063982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626693fd-6fd3-4eb8-b03c-edb9d5e3e7ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.074504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.075903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:47.095141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:47.096147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:47.097030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:47.097030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:47.097030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.100056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 431/851] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:47.102706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.111134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.112085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.112582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.113498 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.114433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.115411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.117667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.142669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 421/852] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 17 11:09:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.150886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.221388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff40f-613d-44f4-b77d-43c9adc15c09 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.258460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.259076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.259352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.259622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.260297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.261039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.262692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.272577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.273591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3124bf-e189-4b0e-b67d-5df91c823faa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.276655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 432/853] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.277695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.289372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.317183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.317795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.318067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.318436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.382095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72422f-4cad-427b-9997-4de1d13bceaf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.391828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.393331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.416671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.417304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.417580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.417848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.418437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.420139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:47.429126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:47.430136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.431015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 433/854] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:47.431835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.498803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.502790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 422/855] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:09:47.503644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.517428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.542882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac845-4df8-494c-8612-0ae1f19f1621 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.578353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.579090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.579433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.579772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.586861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.588350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:47.599700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:47.600809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.601718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 434/856] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:47.602200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.617291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55ca11-28c5-4fac-8b3b-d8bd465ff649 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.653045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.653673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.653950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.654335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.654964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.655263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.656737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.666295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 423/857] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.666295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.714080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b46b73-3239-4df1-b8e8-55a6b1485357 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.739053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.740190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.751560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.752235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.752513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.752785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.763358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.764853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.769336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11c2a-0e89-4d64-8b23-7764e70b1b9f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:47.778477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:47.779412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:47.780416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:47.780416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:47.780416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:47.780416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 435/858] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:47.780416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.807108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.807817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.808212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.808485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.809169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.809472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.810935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df497617-321a-43e5-9e93-a4e3d1b2bb04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.823012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 424/859] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.824249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52533-30ee-446e-b059-b76d1d7dc56d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.824528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52533-30ee-446e-b059-b76d1d7dc56d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.824796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be52533-30ee-446e-b059-b76d1d7dc56d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.826116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 425/860] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:47.829158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be52533-30ee-446e-b059-b76d1d7dc56d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.881880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6bbc-8bfe-4b3d-9fc9-03b5ec50306e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.916233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.916821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.917103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.917376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.918017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.918319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.920029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.924504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 436/861] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.925316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:47.935641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be52533-30ee-446e-b059-b76d1d7dc56d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:47.968874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.975173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:47.976084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.976371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.976639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:47.977356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:47.977661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:47.979174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346d44-6fbf-4092-9078-648c7638d9c3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:47.988072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:47.992299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 426/862] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:47.993627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:47.993915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:47.994192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.013003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:48.014214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:48.057919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ee54f-e231-49a3-9dc2-ab3c42c91493 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.095029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 427/863] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:48.095729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.102992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.103606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.103932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.104635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.105424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=b0163816d4024a9c81548f4eb0555bfe) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:48.105729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.107955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.120025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 437/864] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:47 2022] GET /identity/v3/role_assignments?user.id=b0163816d4024a9c81548f4eb0555bfe&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:48.215446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5925f8c-bfd3-4325-844b-f22952518a05 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.248235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:48.261211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.261860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.262136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.262403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.270143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.271691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:48.284022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:48.285372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:48.286251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:48.287998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 428/865] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:48.291361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.371120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.406603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c598a4-5307-4952-b2cd-fe53cc02b5d0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.410382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:48.452719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.454252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.454539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.454816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.455533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:48.455846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.457330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.477959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 438/866] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:48.480650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.491186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78089284-5813-4ab6-bfd8-a066d1e7a8de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.531200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.531852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.532186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.532612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.533011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.534900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:48.547516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:48.548568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:48.549613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 429/867] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:48.555654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.604121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eadeda-7e2f-4dde-9177-dec8757394a6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.608284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:48.639630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.640346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.640622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.640891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.641668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=89e54d17894648ff81de2b23119732fa) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:48.641978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.643440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.650035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 439/868] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/role_assignments?user.id=89e54d17894648ff81de2b23119732fa&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:48.674836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094d6a2-5825-4f06-8530-01d79f5cf6f5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.730704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.731270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.731549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.731820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.732514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:48.732820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.736971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dfe04-59e8-42fe-83ff-80f69c1432b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.740056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 430/869] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:48.745741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:48.781833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:48.864305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba7757-544f-4b4c-93d9-050498af0e74 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:48.903669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:48.904364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:48.904646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:48.904922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:48.905624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:48.905930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:48.907302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ceb37-cace-41a9-90d3-003e770af688 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:48.912404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 440/870] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:49.840667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901bdba-e17c-459c-b1c1-4dbaebfe4141 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:49.841329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901bdba-e17c-459c-b1c1-4dbaebfe4141 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:49.841329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901bdba-e17c-459c-b1c1-4dbaebfe4141 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:49.842808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 431/871] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:49.848205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00117c3-bdf3-4ac4-a19c-74c353573a99 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:49.848619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00117c3-bdf3-4ac4-a19c-74c353573a99 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:49.848780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00117c3-bdf3-4ac4-a19c-74c353573a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:49.867345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b00117c3-bdf3-4ac4-a19c-74c353573a99 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:49.868578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b00117c3-bdf3-4ac4-a19c-74c353573a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:49.939474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 441/872] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:50.204805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901bdba-e17c-459c-b1c1-4dbaebfe4141 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:50.214031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a383d1-3280-4dd2-b776-e3866fac540d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.214307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a383d1-3280-4dd2-b776-e3866fac540d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.215074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a383d1-3280-4dd2-b776-e3866fac540d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.217068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 442/873] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:50.223528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.223811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.224121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.249611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:50.250815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:50.272127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:50.331050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901bdba-e17c-459c-b1c1-4dbaebfe4141 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:50.332051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 443/874] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:50.346276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:50.372381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:50.373058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.373341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.373617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.374334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:50.375717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773bc79-366d-487c-8c77-b1b2178ca9d9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:50.392579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 432/875] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:09:50 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:50.603964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:50.633891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d926-42f6-44d2-80eb-ca144c546d64 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.634210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d926-42f6-44d2-80eb-ca144c546d64 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.634428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d926-42f6-44d2-80eb-ca144c546d64 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.636064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 433/876] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:50.641214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.641490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.641757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.660871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:50.662289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:50.705213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805cc8-0042-4e88-a3ea-b0d8023eea13 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:50.743630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:50.750974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.750974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.750974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.751274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 434/877] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:50.762407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-db48a0af-f35f-422a-a8fb-54ea6c4687c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:50.767413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:50.768571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:09:50.769410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:50.771846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 444/878] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:09:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:50.778130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:50.819667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93170-e621-4a69-9c5e-6ab37ac61cee None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.820006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93170-e621-4a69-9c5e-6ab37ac61cee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.820284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b93170-e621-4a69-9c5e-6ab37ac61cee None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.821871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 445/879] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:50.826795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.827074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.827350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.845385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:50.846559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:50.854938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:50.896329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:50.908474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730392-acfd-40ec-92af-6f79f08877fe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:50.926957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:50.959833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:50.960736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:50.961218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:50.961666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:50.962488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:50.962980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:50.964585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:50.974072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 435/881] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:09:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:50.980199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.025107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.091894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0022159-9617-42b6-bbbf-d4e3d8de7a4d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.124324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfc693-f9d9-4164-ab38-7a16840e2a23 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.129382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.130278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.130856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.131515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.144118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.145889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.148150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:51.160635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.161402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.161814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.162326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.163176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:51.163892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:51.164973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:51.165911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:51.165911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:51.165911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:51.166083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.173038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 447/882] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:51.174132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:51.175279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:51.176315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:51.177174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:51.182149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 436/883] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:51.183149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.209587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:51.290853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba805e-3fc6-40a9-89ba-20de42ff34b1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.293006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338559e6-9cb3-42ef-a40e-adeb53b53c89 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.330994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.331603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.331731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.331873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.332166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.332460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.332796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.332894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:51.333090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.333197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.334367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:51.334841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.335062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.336580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.344733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 437/884] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:51.344733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.352005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 448/885] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:51.356613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.418940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:51.440242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:51.457157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21b42d-3707-4950-82cd-44875085109c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.475515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b74af-5c92-4c23-8c40-f33c9b07532d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.496104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.496862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.497231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.497596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.498328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.499811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.515617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.516253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.516528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.516833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.517472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:51.517768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.519171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.524646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 449/886] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:51.525370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.536296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 438/887] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:09:51 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:51.657825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b3797-b7d7-4aae-9152-a51e63b319fe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.682992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:51.713694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.714490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.714862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.715228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.723092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.727426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:51.741120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:51.742238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:51.743394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:51.745271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 450/888] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:51.751244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:51.858108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e46e5-86e2-4b28-9fa4-06965f0aaa5a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:51.896734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:51.897374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:51.897618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:51.897891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:51.898624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:51.898931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:51.900400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:51.923757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 439/889] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:51.925154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.042479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce50d3-6bcb-47d2-9cf6-664a0de254b5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.076248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:52.076908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.077188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.077501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.121779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.148329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:52.149779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781158c5-3c8a-4435-af1e-9700ee5fc9fb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:52.257963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 451/890] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:09:51 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:09:52.263393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.267351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.376852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2ac0-6be6-4dff-91b8-d64b3f57b633 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.400789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b387b-6f68-430b-832a-491c8148961a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.401083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b387b-6f68-430b-832a-491c8148961a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.401342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b387b-6f68-430b-832a-491c8148961a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.402872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 452/891] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:52.409449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.409449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.409449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.423323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:52.423979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.424257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.424920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.431224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:52.432686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:52.437610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:52.439119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:52.457078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:52.458052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:52.459523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:52.459523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:52.459523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:52.459523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 440/892] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:52.463758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.525753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.535548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 453/893] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:52.576951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e10e7-bf19-4dcb-b0eb-5c3c815906cd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.612215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:52.612832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.613110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.613378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.614031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:52.614329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:52.615765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:52.635772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 441/894] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:52.638318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.643852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.756847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b886-44ec-4a48-b854-3fbc5469da6f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.796868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:52.797795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.798215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.798624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.803144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.806635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:52.808379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:52.820467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:52.821561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:52.822670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:52.824768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 454/895] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:52.836834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:52.907054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.909419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a440d77-1c2e-4caa-8f97-049ea28f9865 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.928319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:52.959307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055dfd9-e27e-45a0-8fc0-ce6500307d72 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:52.966092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:52.967827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:52.968337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:52.968812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:52.970487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:52.974777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:52.996947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:52.999956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:53.002374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 442/896] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:53.007430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:53.011751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.013064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.013779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.014491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.016078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:53.016845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.019642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.042074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 455/897] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:53.053535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:53.122584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d519e0-963b-4af5-8cd7-9d4c82a4485a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:53.167049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.168332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.169187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.170227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.171707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:53.172282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.176364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.191964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 443/898] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:53.195259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:53.235713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3c85-2b90-4bbb-9c2f-c4737ca69b40 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:53.260248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:53.263476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:53.277436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.278188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.278558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.278917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.279761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] RBAC: Adding query filter params (role.id=bd63eb3e4ecd45a49c7cfc17aff8a328, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=b0163816d4024a9c81548f4eb0555bfe) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:53.280198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.281829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.288366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 456/899] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:09:53 2022] GET /identity/v3/role_assignments?user.id=b0163816d4024a9c81548f4eb0555bfe&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:53.335163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb86b-c17a-41a3-8480-aa0bd0d7d1fc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:53.374159 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.374787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.375062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.375332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.376008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:53.376311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.377697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.384133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 444/900] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:53.390378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:53.498600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167eef3-b5ef-433b-927a-2c1051fd0dcb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:53.532864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.533474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.533750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.534019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.534784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] RBAC: Adding query filter params (interface=public, service_id=4503b137d6584c25b7b7d9eb958bff72, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:53.535088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.536516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6a4f4-e2b3-4d0d-89e8-289b9370aed4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.542128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 457/901] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:09:53 2022] GET /identity/v3/endpoints?service_id=4503b137d6584c25b7b7d9eb958bff72&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:53.548006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:53.596635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac206f-c839-4e80-ae30-17e28f108a1f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.596955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac206f-c839-4e80-ae30-17e28f108a1f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.597442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac206f-c839-4e80-ae30-17e28f108a1f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.599556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 458/902] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:53.604530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05128-639a-4fe0-9836-25f3a2f8dd71 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.604916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05128-639a-4fe0-9836-25f3a2f8dd71 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.605284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05128-639a-4fe0-9836-25f3a2f8dd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.628683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bbf05128-639a-4fe0-9836-25f3a2f8dd71 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:53.630129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bbf05128-639a-4fe0-9836-25f3a2f8dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:53.658725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebc9b1-935c-4548-a2a3-67e24a019fe1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:53.672254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:53.698770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:53.702236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:53.703177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.703520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.703856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.704695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:53.706683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019028e-8a32-4a8e-9119-1c03f6d40c97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:53.713958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 445/903] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:09:53 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:09:53.714554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 459/904] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:53.716976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ffeb9-d5ea-4fee-9bac-624007d3e940 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.717262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ffeb9-d5ea-4fee-9bac-624007d3e940 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.717531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ffeb9-d5ea-4fee-9bac-624007d3e940 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.719239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 446/905] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:53.727360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:53.727360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:53.727360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:53.751230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:53.752412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:53.826564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 460/906] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:53.995733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ffeb9-d5ea-4fee-9bac-624007d3e940 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.102287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.102784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ffeb9-d5ea-4fee-9bac-624007d3e940 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.140435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.141048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.141326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.141598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.142259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.143635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.160222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 447/907] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:09:53 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:54.229955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5833c6-53e6-4eca-8562-36934caeb548 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.247812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:54.278481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.279567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.280077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.280748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.281758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.283287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:54.294378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:54.295580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:54.296715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:54.299268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 461/908] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 17 11:09:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:54.305285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.344241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:54.424316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c8b60-a05e-450a-b9fe-bf5b5e183b43 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.461554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.462169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.462440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.462708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.463339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:54.463632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.465037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.470302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 448/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:54.475933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.574269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f728-baa8-4a01-92ac-0a255b7e8c22 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.607078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.608015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.608493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.608998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.609875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:54.610387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.612032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.617521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 462/910] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:54.623597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.723834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:54.732419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915796-7c68-4f29-a34d-c7182b72b574 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.769915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.770537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.770839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.771109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.771806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] RBAC: Adding query filter params (interface=public, service_id=fe1e185d1a094be0b1ce5b1f2b04e78c, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:54.772132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.773506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b27de6-c9e4-4246-8384-785d10cd9366 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.779084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 449/911] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:09:54 2022] GET /identity/v3/endpoints?service_id=fe1e185d1a094be0b1ce5b1f2b04e78c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:54.784337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:54.820133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:54.891947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006903e-2cbf-432c-b3ef-5e75f3dfd510 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:54.927780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:54.928425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:54.928699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:54.928963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:54.929566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:54.931063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba41cc6-cea0-478c-8872-3e2a4b586ea4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:54.937336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 463/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:09:54 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:09:55.288575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6254-460e-4395-81cd-2b11bfb0d3fd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.289112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6254-460e-4395-81cd-2b11bfb0d3fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.289605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6254-460e-4395-81cd-2b11bfb0d3fd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.291348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 450/913] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:55.297423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca7db-53ad-4a7b-908b-c29e7af259e4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.298616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca7db-53ad-4a7b-908b-c29e7af259e4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.298616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eca7db-53ad-4a7b-908b-c29e7af259e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.317772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-32eca7db-53ad-4a7b-908b-c29e7af259e4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:55.319058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32eca7db-53ad-4a7b-908b-c29e7af259e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:55.396831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 464/914] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:55.662478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6254-460e-4395-81cd-2b11bfb0d3fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:55.721397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad9fd-e115-4b3c-86fd-358d4d4b094a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.721724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad9fd-e115-4b3c-86fd-358d4d4b094a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.721944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ad9fd-e115-4b3c-86fd-358d4d4b094a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.730149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 465/915] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:55.740403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.740907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.741402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.759553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:55.761119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:55.770487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6254-460e-4395-81cd-2b11bfb0d3fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:55.786656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:55.810149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:55.810794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.811074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.811347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.822635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:09:55.827844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:55.828833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:55.829831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 451/916] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:09:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:55.834751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:55.848129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 466/917] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:09:55.859767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:55.938616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd3b-9519-4723-8795-f4d7ac2169f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:55.975069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:55.975684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:55.975997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:55.976262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:55.976936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:55.977237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:55.978714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:55.987154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 452/918] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:09:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:55.993083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.094136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7f40-cd50-4b4d-89db-b33fee1d4398 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.128111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.129531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.130490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.131261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.131735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.143293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.145165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:56.162131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:56.163413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:56.164425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:56.164425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:56.164425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:56.166680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 467/919] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:56.172395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.194106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.223549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.241973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fda730-e5c6-4880-bfe1-053e311ac287 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.281262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.281899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.282179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.282873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.283466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.285137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-59127821-fe69-49d9-86ad-cc104e22e41f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:56.294286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:56.295695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 11:09:56.296564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:56.297369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9d67-248e-4237-b8e3-7f83e3254c0f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.300272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 453/920] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:09:56.301459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ac8f-e1a4-4940-9d0a-a194576c7d41 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.301749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ac8f-e1a4-4940-9d0a-a194576c7d41 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.302061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ac8f-e1a4-4940-9d0a-a194576c7d41 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.303518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 454/921] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:56.304929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ac8f-e1a4-4940-9d0a-a194576c7d41 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.338567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.339571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.340037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.340316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.340967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:56.341273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.342649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84812d6-c557-4016-80db-17127ba917ee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.360005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 468/922] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:56.360005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.360005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.360005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.376243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:56.377423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:56.417317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ac8f-e1a4-4940-9d0a-a194576c7d41 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.448867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 469/923] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:56.449619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.451881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.467011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.468033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.468721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.469135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.469928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:56.470368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.472368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.479579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 455/924] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:56.484964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.498428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.563976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a91dfe-880a-471d-9469-c26122143eaf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.599450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.600371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.600746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.601254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.608062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb412a-9cad-4075-8d43-94deeaf7b27e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.608592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.610136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:09:56.622437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:56.623536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:09:56.624513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:56.629095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 470/925] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:56.630365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.651959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.652863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.653336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.653776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.655016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:56.655501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.657537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.664701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 456/926] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:56.670545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.702405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.749873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ad98-4198-470d-976e-09d51f92bb20 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.758110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.785017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.785631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.785908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.786181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.786979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:56.787286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.788761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.789511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcc31-a47e-4375-abe1-e6b8177c658b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.806494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 471/927] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:56.807258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.831944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.832569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.832849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.833161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.834049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.835441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.857234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 457/928] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:09:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:56.858074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.924241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89582c-30b3-48dd-bb0f-901b40579439 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:56.946322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:56.967951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:56.968503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.968775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.969046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.969751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:56.971135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ae4f3ccd-527e-4216-b694-bb214ec428dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:56.980469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:56.981536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:56.982411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 472/929] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:56.983617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277846-a06e-465b-9f41-3178f500eb76 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:56.983617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277846-a06e-465b-9f41-3178f500eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:56.983617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b277846-a06e-465b-9f41-3178f500eb76 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:56.984894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 473/930] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:56.987549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b277846-a06e-465b-9f41-3178f500eb76 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:56.998098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab74ed-0acd-498e-9cb3-10d3b9207c9d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.031900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.041928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.042575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.043698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.043698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.056287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.057877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-bdc88038-cf09-4226-ae38-15033f025f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:09:57.072424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:57.073400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 458/931] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.075663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.095174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:57.096389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:57.114199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b277846-a06e-465b-9f41-3178f500eb76 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.152249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.152860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.153143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.153416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.154050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.154355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.155716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.160595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 474/932] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:09:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:09:57.161362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.173068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 459/933] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:57.173888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.227782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.283324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bb396-a04e-48c6-a101-d8ebbf276f3f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.297592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.308654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97e52c-86d2-4625-9338-2527e55a7c28 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.321346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.322304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.322420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.322990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.323700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.324092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.325648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.336410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 460/934] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:57.337352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.355042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.356538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.357408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.357868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.358756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.359243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.361395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.378904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 475/935] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:57.384279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.444243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4345-4a58-42b6-9897-a38e4d721367 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.479343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.479880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.480186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.480458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.481159 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] RBAC: Adding query filter params (interface=public, service_id=baac4c6ae113480fb1d2701423aa33ec, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.481463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.482840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.489040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 461/936] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/endpoints?service_id=baac4c6ae113480fb1d2701423aa33ec&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:57.490335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.491865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97585c-a388-448d-bb3c-c2f453124d94 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.494737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.532780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.533415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.533700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.533967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.537699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.541017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.542477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:57.554792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:57.555793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 476/937] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:57.561856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.605693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2454-05d5-476d-be8a-6076457dd11e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.648507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.649139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.649411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.649677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.650252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.651729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.660498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442cee2-732d-47c8-a61c-3c80954f806e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:57.660712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:57.661944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:57.665157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 462/938] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:57.665989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.702937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.703552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.703834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.704135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.704750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.706121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.713326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 477/939] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:09:57.720967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.763765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.787494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31201b8-0223-4fd1-964f-8dba591a4775 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.791319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:57.829305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.829931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.830260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.830543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.831236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.831541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.833054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.847166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 463/940] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:57.857768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.864665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1dd8b-2a4a-44ed-a502-876bfaf6367b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:57.912447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:57.913114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:57.913390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:57.913657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:57.914292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:57.914587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:57.915977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:57.921170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 478/941] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:57.933242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:57.976649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59762fbd-1746-48d9-8a1f-bcf8c2623f07 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:58.015901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:58.016501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:58.016777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:58.017050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/b0163816d4024a9c81548f4eb0555bfe/roles/bd63eb3e4ecd45a49c7cfc17aff8a328` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:58.019233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=b0163816d4024a9c81548f4eb0555bfe, role_id=bd63eb3e4ecd45a49c7cfc17aff8a328)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:58.020884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:58.037724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 464/942] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:09:57 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/b0163816d4024a9c81548f4eb0555bfe/roles/bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:09:58.055572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:58.066591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4a95-a644-434d-a187-7cb30c72a66a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:58.105851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:58.106544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:58.106823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:58.107148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:58.107992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:58.108298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:58.109700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858502fe-bfd7-4f71-b000-296e3f21325a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:58.120199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 479/943] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:09:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:58.122051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:58.153050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:58.242289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae338-61b2-43ed-82ee-6692dbe6432b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:58.278067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:58.278582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:58.278907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:58.279245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:58.279954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:58.281317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003ccca-a905-4a56-b8d2-decc084f34dd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:58.306149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 465/944] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:09:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:09:58.798852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d247d-4e90-4502-9022-ce55b71818c2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:58.799384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d247d-4e90-4502-9022-ce55b71818c2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:58.799640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d247d-4e90-4502-9022-ce55b71818c2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:58.801478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 480/945] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:09:58.806890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:58.807282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:58.807656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:58.827014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:58.828225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:58.909135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 466/946] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:09:59.173122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d247d-4e90-4502-9022-ce55b71818c2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:59.282320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d247d-4e90-4502-9022-ce55b71818c2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:59.333077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:59.333702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:59.333978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:59.334245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:59.334902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:59.336445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:59.339119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING keystone.server.flask.common [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 11:09:59.358691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.sql.core [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 11:09:59.358691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 11:09:59.358691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [parameters: {'id': '220041fa8851416b924d4f9d60149b6f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 11:09:59.358691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81460) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 220041fa8851416b924d4f9d60149b6f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 220041fa8851416b924d4f9d60149b6f. Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:09:59.376122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 11:09:59.377021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application yield resource Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise self.value Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application session.commit() Aug 17 11:09:59.378006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.flush() Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application compat.raise_( Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 11:09:59.378914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 11:09:59.379854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:09:59.382484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [parameters: {'id': '220041fa8851416b924d4f9d60149b6f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:59.384656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:59.386738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 220041fa8851416b924d4f9d60149b6f. Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:09:59.388964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 481/947] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 17 11:09:59 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:59.390256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:59.397343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:59.501302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd022c-259b-46af-a7dc-02a28d2b9123 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:59.536281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:59.536985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:59.537260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:59.537528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:59.544623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:59.546129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e8f2f494-3e9d-4598-8e01-107ed29e1129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:09:59.557974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:09:59.558951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:09:59.559901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:09:59.564021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 467/948] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:09:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:09:59.565725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:09:59.582344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:59.680253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df5cd3-4377-4830-9bad-fad977504eca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:09:59.704378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32585-d36c-4326-9c09-31a8a906bb0e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:59.704808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32585-d36c-4326-9c09-31a8a906bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:59.705083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32585-d36c-4326-9c09-31a8a906bb0e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:59.707333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 468/949] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:09:59.718081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779c98-5dac-4c38-a8fb-4204314b3fa2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:59.718390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779c98-5dac-4c38-a8fb-4204314b3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:59.718718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82779c98-5dac-4c38-a8fb-4204314b3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:59.719102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:09:59.719728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:09:59.720038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:09:59.720311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:09:59.720987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:09:59.721288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:09:59.722920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:09:59.748816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-82779c98-5dac-4c38-a8fb-4204314b3fa2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:09:59.750035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82779c98-5dac-4c38-a8fb-4204314b3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:09:59.750446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 482/950] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:09:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:09:59.822191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:09:59.831466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 469/951] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:09:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:00.099409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.126068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518f56-7ed6-46d7-930d-430610693557 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.126507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518f56-7ed6-46d7-930d-430610693557 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.126854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518f56-7ed6-46d7-930d-430610693557 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.128542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 470/952] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:00.135108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81c00-eb3e-4d65-9464-a15b9d224eb5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.135695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81c00-eb3e-4d65-9464-a15b9d224eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.136268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d81c00-eb3e-4d65-9464-a15b9d224eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.155761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b8d81c00-eb3e-4d65-9464-a15b9d224eb5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:00.157388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8d81c00-eb3e-4d65-9464-a15b9d224eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:00.178236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:00.212904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dae165-289b-4f94-bb79-c2048c25634a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.250479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.251149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.251423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.251597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 471/953] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:00.251774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.252374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.252861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298470-90b5-4dd9-ba9c-1b9fae884e07 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.253143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298470-90b5-4dd9-ba9c-1b9fae884e07 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.253412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298470-90b5-4dd9-ba9c-1b9fae884e07 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.253899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:00.254904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 472/954] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:00.261536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.261893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.262231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:00.266335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:00.267586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.268697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 483/955] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:00.274203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.283229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:00.285048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:00.375181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 473/956] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:00.391728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4385-035f-4db7-8aa8-4db03fbc6a65 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.427074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.427693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.428039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.428318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.428961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:00.429268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.430697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:00.432591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:00.436354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 484/957] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:00.442069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.499150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:00.525891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.545104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0742b5-50e3-4b3a-b0cb-8a65deb8f2da None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.579306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.579928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.580208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.580475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.581195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:00.581491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.583023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:00.588663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 474/958] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:00.596978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.638390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6c91d-01c8-4e89-92ab-a3793ec912e8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.676868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.677987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.678439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.678870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.692344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:00.699900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:00.701158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:00.702208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.708075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 485/959] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:00.708959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.719657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2aea4-f12e-41ac-b425-95c011c964cc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.745328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:00.760376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.760989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.761263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.761533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.762183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.763571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:00.779807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:00.785151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 475/960] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:10:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:10:00.794627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.831389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d9eb3-1c6b-4eae-8b74-dfb92664beaa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.881963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.883136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.883716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.884211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.885045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.886893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:00.897353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:00.898417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:00.899317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:00.902641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 486/961] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:00.908307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:00.945533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58de01-b432-4306-b5c7-ee9ef1877c20 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:00.985978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:00.986613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:00.986890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:00.987215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:00.987845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:00.988171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:00.990425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.000600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 476/962] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:01.006617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.033610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b661-7155-4386-ac7a-e670038230bb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.057435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.065679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.075702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.076345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.076617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.076883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.077765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:01.078114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.079565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.085416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 487/963] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:01.091837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.148238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef959-2df1-4c4f-b323-f73d33f47ecc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.185007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.185639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.185913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.186179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.196751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.198263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:01.214622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:01.215628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:01.216545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:01.216545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:01.216545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:01.219847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012a6d-84fd-4d1c-8be4-4b0019b7da56 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.220641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 477/964] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:01.221490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.264468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.265826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.266304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.267076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.268260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:01.268770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.270928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.283955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 488/965] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:01.329318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.340408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88fd2dc-5fe3-4dae-9ada-adfddfc58a0b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.378927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.379551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.380067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.380395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.381062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:01.381363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.382775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.396335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 478/966] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:01.402187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.456857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.511792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf02a6-e08f-42a1-bdd1-f5e1725203ab None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.547633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.548290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.548568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.548840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.556312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.557813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:10:01.569613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:01.570781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:01.571996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 489/967] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:01.578593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.684653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c01bc8-aa92-45dc-925b-637cc9382904 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.723440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.724087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.724367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.724639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.728075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:01.728075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.728075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5add1-50d8-4d3e-876f-f48876e5cb0b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:01.745884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 479/968] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:01.751484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:01.829120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c062-2e89-4df7-a7c6-d6d2f668ccb2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.829491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c062-2e89-4df7-a7c6-d6d2f668ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.829669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59c062-2e89-4df7-a7c6-d6d2f668ccb2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.831254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 480/969] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:01.836568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.836851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.837225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.855237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:01.856461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:01.859195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d317c4-ac22-42e4-8800-ec1386eab869 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:01.860222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.868997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:01.895047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:01.895721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:01.896034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:01.896386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:01.953985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 481/970] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:01.975266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:01.976796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.081048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 490/971] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:01 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:02.088891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.189274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c09903-822a-4adc-861b-4610f3cf7a27 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.223810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.224395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.224670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.224995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.231782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.236459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.238662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.240126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.252373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:02.253856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:02.254928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:02.255866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:02.255866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:02.255866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:02.255866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 482/972] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:02.261235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.363742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f9c70-94b9-4a74-b938-97d7e87f8631 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.383683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3192-61fc-488c-a331-a2016f0e379e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.400255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.401166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.401615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.402104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.403004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.404816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.421349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.421967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.422239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.422508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.422608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.sql.core [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 11:10:02.422608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 11:10:02.422608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [parameters: {'user_id': 'f50dba21b3da48d0bfaee3387cf46574', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 11:10:02.422608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81460) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 11:10:02.423192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:02.423497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.424890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Aug 17 11:10:02.430921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:10:02.431819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application yield resource Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise self.value Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application session.commit() Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 11:10:02.432805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.flush() Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application compat.raise_( Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 11:10:02.433692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 11:10:02.434600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 11:10:02.436997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f50dba21b3da48d0bfaee3387cf46574', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:02.438893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 11:10:02.440774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 11:10:02.442863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.443625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 483/973] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:02.443625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.445861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 491/974] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 17 11:10:02 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:02.455404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.500218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.539136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.573793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8611367-1f9a-499f-85f3-4aa2ad281ba2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.573990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46097815-527a-44e7-978f-e67a76faaa4b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.609428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.610408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.610978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.611436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.616666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.617362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.617646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.617918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.620551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.622389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.625621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.627150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:10:02.634752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:02.635721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 11:10:02.636728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:10:02.639029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:02.639899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:02.640836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:02.641788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 492/975] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:02.644570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 484/976] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:02.645741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.651635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.774492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782580fb-f318-489f-ba07-5c20978b93c4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.778217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a0d0-3d64-4177-85b1-853c5e821288 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:02.791522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.811327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:02.819356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.819692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:02.820007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.820285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.820446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.820558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.820733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.820980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.821252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:02.821557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.821659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:02.821964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:02.822988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cf039-3c4b-49a9-b53a-313b0a321961 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.823379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cba50c-74fa-4446-b1ad-021884adf042 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:02.840216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 485/977] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:02.841388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a62c-ef19-4837-b74e-b72c4636ba72 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.841668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a62c-ef19-4837-b74e-b72c4636ba72 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.841940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a62c-ef19-4837-b74e-b72c4636ba72 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.843150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 486/978] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:02.843822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a62c-ef19-4837-b74e-b72c4636ba72 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:02.866552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 493/979] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:02.867891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:02.868243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:02.868454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:02.889075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:02.890664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:02.973350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 494/980] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:02.990515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a62c-ef19-4837-b74e-b72c4636ba72 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.035150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.035661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.036298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.036767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.038041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] RBAC: Adding query filter params (role.id=bd63eb3e4ecd45a49c7cfc17aff8a328, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=b0163816d4024a9c81548f4eb0555bfe) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:03.038588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.042271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95522-fe73-426c-bc3f-2fa28013d1f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.048815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 487/981] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:02 2022] GET /identity/v3/role_assignments?user.id=b0163816d4024a9c81548f4eb0555bfe&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:03.243467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.320077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da9d7-c63e-481c-b41c-0924b941c98a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.320257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da9d7-c63e-481c-b41c-0924b941c98a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.320538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da9d7-c63e-481c-b41c-0924b941c98a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.322028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 488/982] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:10:03.326639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.326919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.327191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.345095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:03.346269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:03.347258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5330bc-9ae1-4358-964e-b9d5cb78c199 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.369347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:03.375532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:03.389378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd9151-db15-4929-8608-227881e7534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.390031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9151-db15-4929-8608-227881e7534e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.390308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9151-db15-4929-8608-227881e7534e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.390577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9151-db15-4929-8608-227881e7534e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.391159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd9151-db15-4929-8608-227881e7534e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.392557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd9151-db15-4929-8608-227881e7534e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-21dd9151-db15-4929-8608-227881e7534e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:03.411319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:03.412411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:03.413444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 495/983] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:10:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:03.418778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd9151-db15-4929-8608-227881e7534e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.423953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 489/984] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:03.522651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd9151-db15-4929-8608-227881e7534e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.560168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.560779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.561049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.561316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.561939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:03.562236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.563589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.568947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 496/985] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:03.574662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.671987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d99c1b-5bea-4178-b057-d3b5d14c5fc8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.700558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.707515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.708189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.708467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.708713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.709356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:03.709648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.711513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.718718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 490/986] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:03.723618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.752641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:03.761256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:03.819972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672e112-e9a6-4ee6-a734-971df46e6217 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.829796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062b53b-9ce8-4278-8d82-187d36819d07 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:03.855021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.855727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.855998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.856272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.856956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.858506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a9553-b13e-4f9e-b7ca-712fdd58ecd9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.863205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:03.863877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:03.864568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:03.864975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:03.865803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] RBAC: Adding query filter params (interface=admin, service_id=baac4c6ae113480fb1d2701423aa33ec, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:03.866205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:03.867949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:03.873539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 491/987] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Aug 17 11:10:03 2022] GET /identity/v3/endpoints?service_id=baac4c6ae113480fb1d2701423aa33ec&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:03.879947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 497/988] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:10:03 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:10:03.880149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:03.983801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:03.995145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ff0df-47b9-4759-9315-a26d48bb1fcd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:04.038450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:04.039066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:04.039345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:04.039614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:04.040341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:04.041704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1390d3d-7b39-4a7c-9c40-987d718de94d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:04.048783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 492/989] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:10:03 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:10:04.988185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc51e-9a4a-4f6b-b167-21807a549da5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:04.988926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc51e-9a4a-4f6b-b167-21807a549da5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:04.988926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc51e-9a4a-4f6b-b167-21807a549da5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:04.990153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 498/990] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:04.995726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:04.996225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:04.996327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.014865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:05.016063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:05.085445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:05.348179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dc51e-9a4a-4f6b-b167-21807a549da5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:05.453777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dc51e-9a4a-4f6b-b167-21807a549da5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:05.461350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:05.489531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:05.490044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.490290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.490580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.491167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:05.492541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:05.501296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:05.502332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:05.503193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:05.504876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 499/992] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 17 11:10:05 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:05.508326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:05.592850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:05.612850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d868-9522-4350-b3f4-f42609c28de3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:05.648162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:05.648768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.649040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.649307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.649913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:05.650205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:05.651613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d012a-81e5-4b8a-81f4-c234bf7bce4d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:05.656559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 494/993] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:05.662386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:05.779470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339b3f-b488-4d87-872c-8e38fec76ca0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:05.816301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:05.817886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.818316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.818600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.819260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] RBAC: Adding query filter params (type=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:05.819558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:05.820971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b8920-3884-4a1c-b9f5-12fc2aedf227 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:05.826176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 500/994] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:05.833895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e38cb-e9de-473d-86c5-c541a6f0b469 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.834278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e38cb-e9de-473d-86c5-c541a6f0b469 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.834631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e38cb-e9de-473d-86c5-c541a6f0b469 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.836161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 495/995] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:05.842278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.842551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.842801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.862987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:05.864301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:05.895605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:05.928707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afd16-3ce8-4193-aec0-2ee04bf148be None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.928949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afd16-3ce8-4193-aec0-2ee04bf148be None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.929240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afd16-3ce8-4193-aec0-2ee04bf148be None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.930717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 496/996] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:10:05.936176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:05.936486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:05.936994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:05.941989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 501/997] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:05.958585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:05.959808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:06.038087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 497/998] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:06.200726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.301045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fe980-cacf-4298-a6ed-49895cd689fd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.311570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.335766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.336669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.336955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.337212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.337794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.339148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:06.347678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:06.348941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:06.350167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 502/999] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:06.356415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.388527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.405732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.436649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ca8ca-1f6e-4168-b36c-144585c677c4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.469644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4da956-3862-421e-9c24-c7c221b73261 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.474652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.475431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.475713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.476011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.476607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.478550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:06.488419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:06.490338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:06.491190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 498/1000] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:06.495541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.509524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.510157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.510415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.510686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.511326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:06.511614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.513019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.518185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 503/1001] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:06.523869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.605845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924e655-e0fb-46bf-87db-64ca96e03c7a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.622609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.632682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a814ea-6ff9-41b0-b50e-61493fd07b56 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.648048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.648720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.648937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.649207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.649843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:06.650145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.651609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.659980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 499/1002] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:06.663455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.668435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.674716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.675526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.675806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.676145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.677111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:06.677111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.678530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.688416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 504/1003] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:06.689628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.788440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bf45-3d83-4763-9853-48b3d3238156 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.800477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736827e-4454-4e53-bbb6-62df1e7becd1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.836754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.837377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.837750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.838023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.838734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] RBAC: Adding query filter params (interface=public, service_id=3a27b944a9ed4fa1a925d81652125081, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:06.838827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:06.839039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.839575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:06.839910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:06.840224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:06.840483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.840896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:06.841204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:06.842820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:06.846836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 505/1004] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/endpoints?service_id=3a27b944a9ed4fa1a925d81652125081&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:06.852889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.861861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 500/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:06.862412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:06.882544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.936271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:06.970265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40068271-d73e-4e55-8f71-a3063da21d1f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:06.976376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee66c0-38a5-4d8c-be8e-9eb2b16f1c25 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:07.004928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:07.005351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:07.005635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:07.005900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:07.006513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:07.007930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098e540-d05d-4e03-8037-546309361ce8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:07.013785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:07.022410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 506/1006] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:10:06 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:10:07.022615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:07.022615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:07.022615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:07.022615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:07.022615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c9a1-a848-4b28-beca-543557a95502 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:07.035733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 501/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:10:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:10:07.739287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef7d7-de63-4b41-80ed-147305aa5943 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:07.739794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef7d7-de63-4b41-80ed-147305aa5943 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:07.739794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef7d7-de63-4b41-80ed-147305aa5943 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:07.743958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 507/1008] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:07.746595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10e2f-9c4f-4449-b6cf-2d304db4d3d2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:07.747003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10e2f-9c4f-4449-b6cf-2d304db4d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:07.747174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10e2f-9c4f-4449-b6cf-2d304db4d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:07.766158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7a10e2f-9c4f-4449-b6cf-2d304db4d3d2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:07.767365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7a10e2f-9c4f-4449-b6cf-2d304db4d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:07.848318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 502/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:08.111872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ef7d7-de63-4b41-80ed-147305aa5943 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:08.204773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:08.222604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ef7d7-de63-4b41-80ed-147305aa5943 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:08.255320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:08.255938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:08.256237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:08.256502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:08.257143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:08.258502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce742f11-8f60-40e2-b65e-8c7c078db554 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:08.275423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 508/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:10:08 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:08.944694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469125e-0264-4c4b-87fa-1d646f201ec2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:08.945264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469125e-0264-4c4b-87fa-1d646f201ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:08.945264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469125e-0264-4c4b-87fa-1d646f201ec2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:08.946523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 503/1011] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:08.952066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:08.952486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:08.952585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:08.959493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9aa6-50f0-488e-aa04-c9c8ed896a3b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:08.960776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9aa6-50f0-488e-aa04-c9c8ed896a3b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:08.960776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be9aa6-50f0-488e-aa04-c9c8ed896a3b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:08.961347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 504/1012] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:10:08.966570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:08.966828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:08.967130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:08.971463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:08.972683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:08.985672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:08.986826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:09.039521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:09.048842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 509/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:09.063700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 505/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:08 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:09.314024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.330367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.392141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:09.431298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1091e-4d97-4d1a-b299-a8e22064f866 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.444665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd1e1-edc8-442a-b730-c6d49e9c211e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.466472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.467195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.467485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.467753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.468879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.470333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.477298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 510/1015] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:09.478138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.484847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.485482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.485759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.486025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.486609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.487988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:09.496679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:09.497929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:09.498890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 506/1016] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:09.503490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.551890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:09.591183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c68b-8c0d-4e24-90c3-60efe274df77 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.603272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8aa94-5d37-4056-a89e-3bbb22d05c45 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.626426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.627278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.627692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.628252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.629234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.630800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.636489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.637095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.637372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.637644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.638269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:09.638566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.639958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.642388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:09.646265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 507/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:09.651735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.675985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 511/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:10:09 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:09.765871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d194f-a1b3-4692-bf4e-ce0eaa87f43d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.780200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:09.804347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.804956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.805229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.805492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.806124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:09.806422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.807788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc42af-ad4e-4416-99bd-a9176b079af6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.813596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 508/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 17 11:10:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:09.819848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:09.929175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d9e03-46a4-475f-8ce2-9f43d0aaa8aa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:09.962829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:09.964199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:09.964620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:09.965055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:09.965861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:09.967389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558ae75-dd30-41ac-9e00-f8167bb8a4fc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:09.991307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 512/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:10:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:10:10.217494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db035-a47d-42e0-bdf8-d72c0eae73f9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:10.218021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db035-a47d-42e0-bdf8-d72c0eae73f9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:10.218021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db035-a47d-42e0-bdf8-d72c0eae73f9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:10.219302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 509/1021] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:10.224778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:10.225062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:10.225342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:10.244880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:10.246135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:10.291341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:10.325565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 513/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:10.596916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db035-a47d-42e0-bdf8-d72c0eae73f9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:10.707081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db035-a47d-42e0-bdf8-d72c0eae73f9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:10.753396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:10.754059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:10.754350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:10.754619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:10.755200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:10.756619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:10.765475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:10.766457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:10.767312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:10.776279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 510/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 17 11:10:10 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:10.776485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:10.877499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deeeb0-f1d5-4796-856c-ea4074e15ec9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:10.911222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:10.911826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:10.912132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:10.912402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:10.913041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] RBAC: Adding query filter params (name=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:10.913341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:10.914719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:10.920179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 514/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:10.925930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:10.968052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:11.027635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2c2a-e2e1-4715-9c90-c2e8392b8d2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:11.066753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:11.067551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:11.067828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:11.068131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:11.068767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:11.069063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:11.070439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:11.075585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 511/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:11.081358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:11.118382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:11.190849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b46a8-29d1-4fc9-b00e-2054f99007ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:11.225462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:11.226078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:11.226357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:11.226645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:11.227324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] RBAC: Adding query filter params (interface=public, service_id=b4a6ba83e1964205b0c0e5ec753c3d17, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:11.227625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:11.229062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fc8f1-95b1-430f-8cc6-39d6d14b9ea1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:11.234477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 515/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:10:11 2022] GET /identity/v3/endpoints?service_id=b4a6ba83e1964205b0c0e5ec753c3d17&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:11.240254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:11.344016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f01a9e-3a2a-44a7-bbb7-262a6ffe1194 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:11.346418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:11.381696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:11.382306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:11.382582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:11.382857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:11.383453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:11.384880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6229aba-6c5a-4fac-b2de-a20ef6dead0c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:11.391826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 512/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:10:11 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:10:11.638406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccd41-8bfd-4f7c-a713-5bbd0f792655 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:11.638817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccd41-8bfd-4f7c-a713-5bbd0f792655 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:11.638921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccd41-8bfd-4f7c-a713-5bbd0f792655 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:11.640518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 516/1028] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:11.645609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46326-764f-47e9-aa75-2dc63fbcef11 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:11.645860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46326-764f-47e9-aa75-2dc63fbcef11 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:11.646150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46326-764f-47e9-aa75-2dc63fbcef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:11.664492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2ea46326-764f-47e9-aa75-2dc63fbcef11 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:11.665653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ea46326-764f-47e9-aa75-2dc63fbcef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:11.743666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 513/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:12.007684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ccd41-8bfd-4f7c-a713-5bbd0f792655 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:12.008211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70f35-c6e1-4a55-b27f-9e9a81c1dc3c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.008503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70f35-c6e1-4a55-b27f-9e9a81c1dc3c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.008764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70f35-c6e1-4a55-b27f-9e9a81c1dc3c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.010263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 514/1030] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:12.015192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.015443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.015726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.037127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:12.038293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:12.109212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 515/1031] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:12.113371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ccd41-8bfd-4f7c-a713-5bbd0f792655 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:12.116189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:12.148453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:12.149090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.149362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.149631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.150738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:12.152206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:12.153993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 517/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:12.159391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:12.188419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:12.261239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f9c36-b990-4b9b-9042-57279c1dfad2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:12.294750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:12.295354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.295627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.295888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.296559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:12.297986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:12.326894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 516/1033] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:10:12 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:12.379360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:12.492365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c341065-3852-45a3-a103-a29c0d748940 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:12.531619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:12.532218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.532497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.532766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.544433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:12.549095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:12.550037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:12.551061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 518/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:10:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:12.556547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:12.644691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:12.663752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411834f-f3ab-4242-a4b9-c716f038b56a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:12.699880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:12.700521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.700803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.701074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.701748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:12.702048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:12.703435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:12.712698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 517/1035] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:10:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:12.718423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:12.756632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:12.836372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a517-ff4d-4d59-8a64-3962949e98a5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:12.871520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:12.872176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:12.872454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:12.872727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:12.883617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:12.885113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:12.900281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:12.901253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:12.902147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:12.902147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:12.902147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:12.906335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 519/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:12.907702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.014724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b34a-e8dc-4199-9dc1-a22e3aa6fbcf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.049752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.050359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.050684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.050955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.051592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:13.051883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.053279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.064727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 518/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:13.070358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.156710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.177938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd98d-28e4-419a-a7e1-5e811f6ffdc8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.211322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.211963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.212257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.212530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.220829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.222273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d174e975-125f-4285-b182-9ac89ebea107 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:10:13.233715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:13.234676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:13.235628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 520/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:13.242690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.253603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.287811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc222-1a9b-470f-aea6-c2cb3daf69f6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.288151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc222-1a9b-470f-aea6-c2cb3daf69f6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.288393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fc222-1a9b-470f-aea6-c2cb3daf69f6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.289885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 521/1039] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:10:13.294800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.295082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.295350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.313564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:13.314746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:13.352613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bdae2-180e-4155-a9e0-4f2f31baa397 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.391807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 522/1040] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:13.394132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.394838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.395112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.395379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.396138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:13.396437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.397862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.415579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 519/1041] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:13.421403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.499046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.532548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996f00b-8e31-4c66-a57c-db1bfabfae1f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.568164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.568767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.569039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.569298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.637088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.638529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.663607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.711189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.729172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.755347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 523/1042] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 11:10:13.761047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.776258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ed407-9dfd-4a38-b016-a241c2829492 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.814405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.815492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.815796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.816094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.817264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.818869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:13.828391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:13.829422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:13.830468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 520/1043] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:13.836433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.865612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67962aab-2c46-4bd7-a548-f73c490ffa69 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.901113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.901846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.902222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.902585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.913954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.915517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:13.931719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:13.933003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:13.933954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:13.933954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:13.933954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:13.935095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 524/1044] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:13.939401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:13.948108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8b904-2f43-49a5-b5aa-7cfc96750a04 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:13.964704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.979374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:13.989628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:13.990355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:13.990706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:13.990986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:13.991682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:13.992008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:13.993379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.004154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 521/1045] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:14.005044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.044923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177e630-86df-43a0-8305-cdac008f42ea None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.078260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.078877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.079225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.079400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.080081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:14.080386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.081760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.093740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 525/1046] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:14.100015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.118749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b117c-307f-4a3c-815a-2d63ad6abd5a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.158690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.159458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.159740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.160120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.160760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:14.161061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.162451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.167872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 522/1047] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:14.173439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.189610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:14.209665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bc970-d5d4-4af1-bb26-22fa72fed35f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.233321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:14.246894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.247536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.247820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.248119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.255700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.257186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:10:14.268429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:14.269359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:14.270347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 526/1048] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:14.275510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.282502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd56c2e-9c59-48bd-a002-94d9682a9bb7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.316560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.317164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.317437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.317703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.318354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.319709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8fc25-dd89-42b2-9af4-da97bbcace1c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.340113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 523/1049] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:10:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:14.341434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23db-4cff-4ff9-8f3b-46a1bf14d46c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.341723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23db-4cff-4ff9-8f3b-46a1bf14d46c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.341997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b23db-4cff-4ff9-8f3b-46a1bf14d46c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.343213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 524/1050] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:14.349140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.349422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.349701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.369818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:14.371053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:14.395188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233cb8-eef1-4af5-b904-8f04e6446a56 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.442031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.443144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.443795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.444287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.445146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:14.445602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.447349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.448217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 525/1051] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:14.457806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:14.466804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 527/1052] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:14.471521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.519675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:14.580772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a5e39-8b21-4b48-ba45-7bb884390d39 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.616746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.617356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.617634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.617904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.618630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] RBAC: Adding query filter params (role.id=bd63eb3e4ecd45a49c7cfc17aff8a328, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:14.618940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:14.620536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:14.628065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 526/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:14.713184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.833525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439525d-84c4-4d76-a97b-035dbb17e2a1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:14.868281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:14.868917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:14.869196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:14.869474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:14.882172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:14.887142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:14.888432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:14.889313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 528/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:14.896500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:14.998554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6935b6-76fb-4273-bef7-8a2ee6cb02e7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:15.006070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:15.035900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:15.036545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:15.036823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:15.037094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:15.037757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:15.038056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:15.039434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:15.048372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 527/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:15.054464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:15.120421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:15.166489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4b56-b27d-483a-a58d-2421aa11dc33 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:15.201578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:15.202229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:15.202435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:15.202734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] PATH_INFO: `/v3/users/0d1cbac47874442fabb53eebda0ee229` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:15.216996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=0d1cbac47874442fabb53eebda0ee229)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:15.218448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:15.225080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 529/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:15 2022] GET /identity/v3/users/0d1cbac47874442fabb53eebda0ee229 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:15.226690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:15.333093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbfc6d-8e40-44ef-82db-01ba6e954fcd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:15.367047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:15.367660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:15.367941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:15.368242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:15.404364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:15.440277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:15.442052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:15.545284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 528/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:15.551237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:15.652648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d3b84-f7ef-4bee-aeeb-8ec204acb2f6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:15.669731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:15.690273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:15.690927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:15.691290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:15.691559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:15.692878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:15.694317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a993d92-726a-44c5-bd59-15dcaf80f2fd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:15.696185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 530/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:15 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:15.702330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:15.780173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:15.817641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea555f-9147-46a0-b4f7-f01e46ada806 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:15.852691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:15.853359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:15.853635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:15.853905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:15.854802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=9da472ca037646039c1242160b425b2f, user.id=0d1cbac47874442fabb53eebda0ee229) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:15.855108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:15.856629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd74f07-293c-42b3-822e-a8881123da3a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:15.868023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 529/1059] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:15 2022] GET /identity/v3/role_assignments?user.id=0d1cbac47874442fabb53eebda0ee229&scope.project.id=9da472ca037646039c1242160b425b2f&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:16.260495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab95c-5af6-4c3b-8dc1-2d4628245ff3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:16.261040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab95c-5af6-4c3b-8dc1-2d4628245ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:16.261040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab95c-5af6-4c3b-8dc1-2d4628245ff3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:16.262551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 531/1060] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:16.267596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83f57-e125-442b-a15e-c88f9ca441af None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:16.267979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83f57-e125-442b-a15e-c88f9ca441af None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:16.268339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab83f57-e125-442b-a15e-c88f9ca441af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:16.287320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9ab83f57-e125-442b-a15e-c88f9ca441af None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:16.288545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ab83f57-e125-442b-a15e-c88f9ca441af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:16.360535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 530/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:16.527278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441459-afb5-484e-a61f-b34f484b830f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:16.527467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441459-afb5-484e-a61f-b34f484b830f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:16.527728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee441459-afb5-484e-a61f-b34f484b830f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:16.529279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 532/1062] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:16.534323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:16.534809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:16.534890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:16.553978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:16.555155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:16.614561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:16.625926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441459-afb5-484e-a61f-b34f484b830f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:16.627105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 531/1063] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:16.741038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee441459-afb5-484e-a61f-b34f484b830f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:16.776412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:16.777089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:16.777417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:16.777631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:16.835762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:16.853125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:16.854582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:16.892070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:16.969220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 533/1064] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:16.975047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.001951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574e41e-ffee-4154-aec0-f6791ea60d12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.035550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.036122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.036405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.036668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.046887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:17.051500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:17.052484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:17.053315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 532/1065] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:10:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:17.058473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.073042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.090751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd025dd-bf95-4880-a8da-c7dba02c1720 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.116346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.129046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.129974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.130602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.131862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.148628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.150088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.164953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01735267-417e-4e99-828b-16dcfbb402b7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:17.166086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:17.167426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:17.168338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:17.168338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:17.168338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:17.168338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 534/1066] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:17.173371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.202593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.203198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.203474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.203731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.204475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:17.204773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.206245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.214476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 533/1067] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:17.219894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.278999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d477359-8bd2-4e8a-9dcf-cbb75cece961 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.315120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.316158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.316681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.316962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.317604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:17.317887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.319382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.321952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.322455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130a60f-6736-48d1-a9d8-95c27b1226b0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.343957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 535/1068] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:17.348417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.371755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.372538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.372887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.373224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.385923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.387416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:17.403413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:17.404486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:17.405389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:17.405389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:17.405389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:17.405389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 534/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:17.410733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.515057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c696ac-1100-451d-8ec6-f18732096d09 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.552296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.553259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.553259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.553437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.554058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:17.554357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.555899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.568024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 536/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:17.573593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.681070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f65ac9-693e-4646-bf4c-a44c59b7538b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.716148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.716775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.717052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.717320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.725109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.726572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-de433584-b873-4f91-af94-848e82fbcac5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:10:17.738603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:17.739577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:17.741086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 535/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:17.745612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:17.771932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacdfaa-92c9-457a-951f-076d406605a5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.772245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacdfaa-92c9-457a-951f-076d406605a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.772516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacdfaa-92c9-457a-951f-076d406605a5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.773985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 536/1072] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:10:17.778734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.779016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.779289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.798618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:17.799807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:17.802406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.822114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:17.847478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe09d-548c-431d-9373-7fa49ed61d9c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:17.870653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 537/1073] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:17.882489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:17.883100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:17.883380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:17.883650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:17.884418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:17.884725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:17.886151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:17.903939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 537/1074] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:17.909791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.011299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e3c78-2ec5-42d4-a963-e7bf12510860 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.044915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.045533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.045806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.046072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.056629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.058077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:18.072694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:18.073640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:18.074524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:18.074524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:18.074524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:18.074524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 538/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:18.079720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.140822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.153034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.185076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f62f1-a87b-4904-a96d-acd89a2c6eaf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.199649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.220800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.221405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.221678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.221945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.222742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:18.223031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.224427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.241785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 538/1076] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:18.242919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.246012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08887613-4206-46d2-bcfd-a02018aa6d62 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.284435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.285058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.285332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.285601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.297589 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:18.302242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:18.303177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:18.304058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 539/1077] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:18.309234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.348743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dad38-5ee2-4fa1-9ac3-83178443d2e6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.373139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.383330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.383997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.384273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.384544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.391467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.392766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:10:18.404757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:18.405652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:18.406571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:18.407008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42b6e3-6496-42b1-ba7b-2fb6ad10f9d0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.407084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 539/1078] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:18.412463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.442256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.442866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.443140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.443403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.444095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:18.444391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.445747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.446171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.454731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 540/1079] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:18.460790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.515805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5bcb-215e-4265-940b-585f55446565 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.550240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.550883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.551249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.551527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.552235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:18.552557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.553996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.564921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5622c5e-b105-497b-9c44-e58c52ede2e8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.566665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 540/1080] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:18.572539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.594353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.602128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.602704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.602985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.603259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] PATH_INFO: `/v3/users/0d1cbac47874442fabb53eebda0ee229` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.604450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] RBAC: Authorizing `identity:get_user(user_id=0d1cbac47874442fabb53eebda0ee229)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.605901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.607673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 541/1081] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/users/0d1cbac47874442fabb53eebda0ee229 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:18.615467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.671612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:18.679480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366463e-ed29-4419-87b7-e734b94570c1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.713684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.714343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.714620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.714891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/bd63eb3e4ecd45a49c7cfc17aff8a328` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.716446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43e22-6383-4003-b982-40fa09acf19d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.717062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=991c9767714849039e301854775dac09, role_id=bd63eb3e4ecd45a49c7cfc17aff8a328)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.718532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.732966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 541/1082] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:10:18 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/991c9767714849039e301854775dac09/roles/bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:10:18.757893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.758569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.758848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.759118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.760433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.761917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e2091-b332-475d-b6f2-ba9125e35b48 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.763622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 542/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:18 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:18.770322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:18.884609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b0478-6cc7-425f-b841-fffb899b0451 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:18.919409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:18.920112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:18.920391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:18.920663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f/users/0d1cbac47874442fabb53eebda0ee229/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:18.922696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9da472ca037646039c1242160b425b2f, user_id=0d1cbac47874442fabb53eebda0ee229, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:18.924167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bde4d5-08b1-4539-8077-519519eae7f2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:18.938779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 542/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:10:18 2022] PUT /identity/v3/projects/9da472ca037646039c1242160b425b2f/users/0d1cbac47874442fabb53eebda0ee229/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:10:20.595812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61202-33c0-4227-abbd-2a1868e0f8bd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:20.596455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61202-33c0-4227-abbd-2a1868e0f8bd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:20.596455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61202-33c0-4227-abbd-2a1868e0f8bd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:20.597802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 543/1085] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:20.602980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee30-1344-4b75-8576-3c9bb79b12df None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:20.603402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee30-1344-4b75-8576-3c9bb79b12df None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:20.603494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6ee30-1344-4b75-8576-3c9bb79b12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:20.622011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-efb6ee30-1344-4b75-8576-3c9bb79b12df None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:20.623209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-efb6ee30-1344-4b75-8576-3c9bb79b12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:20.632710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:20.694921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 543/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:20.808082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ca86-44a4-4440-a5a6-219d78e1e50c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:20.808383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ca86-44a4-4440-a5a6-219d78e1e50c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:20.808657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ca86-44a4-4440-a5a6-219d78e1e50c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:20.809990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 544/1087] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:20.815422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:20.816254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:20.816405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:20.835458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:20.836772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:20.908970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 544/1088] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:20.960221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ca86-44a4-4440-a5a6-219d78e1e50c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.029227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.067853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ca86-44a4-4440-a5a6-219d78e1e50c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.105101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.105725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.106005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.106272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.117111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:21.121776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:21.122744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:21.123642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 545/1089] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 17 11:10:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:21.129116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.173149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.215646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.241254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c40505-7397-4793-b9ea-de2511e1cb92 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.274615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88899cb3-d421-4de9-93d9-c5ca27befe63 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.276386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.276996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.277270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.277539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.278204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:21.278507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.279869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.288084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 545/1090] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:21.294298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.300980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.310285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.310925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.311201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.311474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.322101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:21.326921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:21.328054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:21.329216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:21.332094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 546/1091] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:21.334206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.393077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3c489-6c0b-45b9-b053-9a5e33a76496 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.426353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.426918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.427196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.427461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.430386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.436001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af50112-337b-4585-8ac0-17755c2aca45 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.438709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.440189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:21.454080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:21.455225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:21.456668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:21.456668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:21.456668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:21.456668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 546/1092] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:21.461203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.470390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.470979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.471254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.471521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.472248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:21.472545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.473909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.482350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 547/1093] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:21.488289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.536131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.563192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9b483-589f-4a69-985a-c803e89fa45e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.586666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3e789-937a-478a-88c5-3fd739c16f7f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.598866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.599474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.599750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.600047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.600692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:21.601040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.602463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.614302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 547/1094] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:21.619870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.625344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.626056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.626394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.626670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] PATH_INFO: `/v3/users/0d1cbac47874442fabb53eebda0ee229` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.627824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] RBAC: Authorizing `identity:get_user(user_id=0d1cbac47874442fabb53eebda0ee229)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.629383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.630987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 548/1095] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/users/0d1cbac47874442fabb53eebda0ee229 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:21.636980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.667796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.718458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c435f-ffbc-40e9-94ed-cdce5d5b21ba None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.745552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f88a4-f460-4474-aaf8-68a91e5a3e2d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.751741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.752416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.752696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.752969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.760623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.762074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.763196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:10:21.773850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:21.774819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:21.775785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 548/1096] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:10:21.780636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.783028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.783642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.783904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.784330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.850653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.852240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.879570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73d78-d61b-4e7d-a35d-9c03d5e95a23 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:21.888127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:21.914912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:21.915529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:21.915807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:21.916111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:21.917945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:21.917945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:21.918876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:21.939196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 549/1097] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:21.944988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.951574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 549/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 11:10:21.958070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:21.976017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.048450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a252b39-1a59-4f0b-9ef3-8c273b3cbeb9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.062266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ac9a8-c0c8-4c03-925a-43e8e3fd560b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.082409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.083017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.083292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.083561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.097378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.098002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.098276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.098549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.099675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.101140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.102768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 550/1099] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:22.108811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:22.118331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.155375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.156861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.196084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.212578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfca66-b6b4-436e-9259-82a6ed8c0b3d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.247837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.248432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.248703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.248966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.249694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=9da472ca037646039c1242160b425b2f, user.id=0d1cbac47874442fabb53eebda0ee229) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:22.249996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.251433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.253687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 550/1100] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 11:10:22.271949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 551/1101] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/role_assignments?user.id=0d1cbac47874442fabb53eebda0ee229&scope.project.id=9da472ca037646039c1242160b425b2f&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:22.272233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:22.330392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.368134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f91098-33a1-453e-8607-986b83e7538d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.403776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.404454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.404731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.405001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.415514 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.417328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:22.432472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:22.434223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:10:22.435803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:22.435803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:10:22.435803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:22.435803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 551/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:22.443739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:22.546395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac90f5-a544-473c-b834-7837fd6da312 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.582200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.583213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.583724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.584027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.584668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:22.584965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.586341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.601606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 552/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:22.607437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:22.714072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0006-76d8-48d5-9af5-42852e3da79d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.732454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.752584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.753858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.754140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.754408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.761308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.762764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:10:22.775305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:22.776374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:10:22.777465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:22.780261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 552/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:22.782492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:22.794720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:22.886899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d6024-0796-4932-bbc3-8fe8ba200e98 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:22.930281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:22.930883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:22.931159 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:22.931430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:22.932141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:22.932444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:22.933872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc754887-efe9-471f-8751-7e5f7246621b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:22.946731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 553/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:22.953246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:23.056186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49839c7-c2ca-4c63-b80e-2ce951b88131 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:23.091273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:23.091860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:23.092163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:23.092437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:23.093150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] RBAC: Adding query filter params (role.id=bd63eb3e4ecd45a49c7cfc17aff8a328, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=991c9767714849039e301854775dac09) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:23.093455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:23.094890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d71eac-11bb-4318-82f1-f001563ed2da None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:23.101377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 553/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:22 2022] GET /identity/v3/role_assignments?user.id=991c9767714849039e301854775dac09&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=bd63eb3e4ecd45a49c7cfc17aff8a328 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:24.214417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82387e-af03-4717-85ec-5dc7279f7527 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:24.215271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82387e-af03-4717-85ec-5dc7279f7527 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:24.215271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82387e-af03-4717-85ec-5dc7279f7527 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:24.217390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 554/1107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:24.224071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:24.224849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:24.224998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:24.248925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:24.250117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:24.287885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:24.321307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 554/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:24.591208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82387e-af03-4717-85ec-5dc7279f7527 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:24.670342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:24.705709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82387e-af03-4717-85ec-5dc7279f7527 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:24.745088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:24.746114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:24.746528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:24.746923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:24.748978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:24.751233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1550a7a-aa9a-41f8-8e46-e7f868ec24f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:24.753633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 555/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:24.760380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:24.871559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c652a0d-fa84-4e57-a392-6d279e82297a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:24.906697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:24.907300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:24.907580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:24.907853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:24.908535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:24.910080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a70183-b32e-4f5d-abc1-de8a86736be5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:24.936136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 555/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:10:24 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:26.906001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5055d-965e-40ab-9b7c-187c0f8a5ffe None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:26.906842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5055d-965e-40ab-9b7c-187c0f8a5ffe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:26.906842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5055d-965e-40ab-9b7c-187c0f8a5ffe None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:26.909197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 556/1111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:26.915034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:26.915445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:26.915535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:26.934414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:26.935610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:26.958400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:27.008220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 556/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:27.282011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5055d-965e-40ab-9b7c-187c0f8a5ffe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:27.404687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5055d-965e-40ab-9b7c-187c0f8a5ffe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:27.440864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:27.441493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:27.441771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:27.442039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] PATH_INFO: `/v3/roles/558419835357498886a96d0af76609b8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:27.443514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] RBAC: Authorizing `identity:get_role(role_id=558419835357498886a96d0af76609b8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:27.444931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:27.446274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 557/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:27 2022] GET /identity/v3/roles/558419835357498886a96d0af76609b8 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:27.452391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:27.550963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660272d0-d8f0-4eaf-a818-0bf8249f2086 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:27.585827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:27.586433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:27.586707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:27.586978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] PATH_INFO: `/v3/users/fbe5765b3b7945e0b22c84c8ae57991c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:27.600256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] RBAC: Authorizing `identity:get_user(user_id=fbe5765b3b7945e0b22c84c8ae57991c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:27.601700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:27.603276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 557/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:27 2022] GET /identity/v3/users/fbe5765b3b7945e0b22c84c8ae57991c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:27.609218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:27.613701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:27.718972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cdce5-1c25-40fc-8a96-c06d1e09f875 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:27.761644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:27.762244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:27.762515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:27.762786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:27.843638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:27.845055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:27.847814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:27.958488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 558/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:27.968109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:27.995640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:28.084051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317fb48-bfb3-4992-a252-c4a6bc6fcda4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:28.119832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:28.120417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:28.120687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:28.120957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:28.122194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:28.123622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd740-08d8-47c1-b529-cab61659977b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:28.125269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 558/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:27 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:28.131959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:28.239371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e759b-8515-43d0-b776-7b4cbee2c6d4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:28.241717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:28.274869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:28.275460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:28.275730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:28.276025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:28.276745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=9da472ca037646039c1242160b425b2f, user.id=fbe5765b3b7945e0b22c84c8ae57991c) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:28.277047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:28.278475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af59dac-a996-4e09-a961-2f997bd892fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:28.284123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 559/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:28 2022] GET /identity/v3/role_assignments?user.id=fbe5765b3b7945e0b22c84c8ae57991c&scope.project.id=9da472ca037646039c1242160b425b2f&role.id=558419835357498886a96d0af76609b8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:30.137591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e504f-67ce-41d3-b56c-19a9907a2d27 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:30.138550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e504f-67ce-41d3-b56c-19a9907a2d27 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:30.138550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e504f-67ce-41d3-b56c-19a9907a2d27 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:30.140737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 559/1118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:30.146236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:30.146683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:30.146780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:30.166620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:30.167817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:30.258425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 560/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:30.525592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e504f-67ce-41d3-b56c-19a9907a2d27 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:30.617689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:30.635110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e504f-67ce-41d3-b56c-19a9907a2d27 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:30.670011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:30.670634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:30.670911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:30.671180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] PATH_INFO: `/v3/roles/558419835357498886a96d0af76609b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:30.672709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] RBAC: Authorizing `identity:get_role(role_id=558419835357498886a96d0af76609b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:30.674108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:30.675516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 560/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:30 2022] GET /identity/v3/roles/558419835357498886a96d0af76609b8 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:30.682368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:30.787129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:30.792342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c964c-1473-415b-be26-fb973b95ba99 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:30.827249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:30.827864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:30.828166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:30.828426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] PATH_INFO: `/v3/users/fbe5765b3b7945e0b22c84c8ae57991c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:30.829656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] RBAC: Authorizing `identity:get_user(user_id=fbe5765b3b7945e0b22c84c8ae57991c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:30.831522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:30.833122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 561/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:30 2022] GET /identity/v3/users/fbe5765b3b7945e0b22c84c8ae57991c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:30.839506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:30.953097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54ff4d-a74c-4449-a7a0-4bfc9f71ac57 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:30.988473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:30.989093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:30.989371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:30.989642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:30.990889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:30.992367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb840ea1-f3a9-4680-8b12-c69ed6878b78 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:30.993990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 561/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:30 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:31.001000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:31.113912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad31a5-0e28-46be-b0b4-b42bae214a16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:31.152664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:31.153275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:31.153549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:31.153815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f/users/fbe5765b3b7945e0b22c84c8ae57991c/roles/558419835357498886a96d0af76609b8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:31.156370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=9da472ca037646039c1242160b425b2f, user_id=fbe5765b3b7945e0b22c84c8ae57991c, role_id=558419835357498886a96d0af76609b8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:31.157790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2f8a5-b17e-4a3e-9910-12eded442b31 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:31.174092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 562/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:10:30 2022] PUT /identity/v3/projects/9da472ca037646039c1242160b425b2f/users/fbe5765b3b7945e0b22c84c8ae57991c/roles/558419835357498886a96d0af76609b8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:10:33.032419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db16-4a3d-4a9c-9907-d83d686155b3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:33.032961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db16-4a3d-4a9c-9907-d83d686155b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:33.032961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5db16-4a3d-4a9c-9907-d83d686155b3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:33.034315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 562/1124] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:33.040716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:33.041803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:33.041938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:33.070424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:33.071617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:33.093500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:33.157573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 563/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:33.426509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5db16-4a3d-4a9c-9907-d83d686155b3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:33.452022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:33.536912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5db16-4a3d-4a9c-9907-d83d686155b3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:33.574197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:33.574826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:33.575100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:33.575363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] PATH_INFO: `/v3/roles/558419835357498886a96d0af76609b8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:33.576939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] RBAC: Authorizing `identity:get_role(role_id=558419835357498886a96d0af76609b8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:33.578322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:33.579646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 563/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:33 2022] GET /identity/v3/roles/558419835357498886a96d0af76609b8 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:33.586150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:33.706975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de8539-c6f2-41c2-9c02-faeb2f8bc6db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:33.748925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:33.750081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:33.750532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:33.750993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] PATH_INFO: `/v3/users/fbe5765b3b7945e0b22c84c8ae57991c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:33.752894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] RBAC: Authorizing `identity:get_user(user_id=fbe5765b3b7945e0b22c84c8ae57991c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:33.754358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:33.755968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 564/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:33 2022] GET /identity/v3/users/fbe5765b3b7945e0b22c84c8ae57991c => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:33.761994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:33.851231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:33.872355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418b606-4b9e-4d83-b0ea-641471b135dc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:33.916679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:33.917288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:33.917560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:33.917825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:34.001171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:34.003082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:34.106222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:34.121665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 564/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:34.128671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:34.156573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:34.233745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b394-587e-4f9e-883a-383a5a6b0be7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:34.272171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:34.272730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:34.273007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:34.273276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] PATH_INFO: `/v3/projects/9da472ca037646039c1242160b425b2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:34.274447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] RBAC: Authorizing `identity:get_project(project_id=9da472ca037646039c1242160b425b2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:34.275938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef350c4-4813-4c46-8598-d96c3bc6a291 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:34.277572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 565/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:34 2022] GET /identity/v3/projects/9da472ca037646039c1242160b425b2f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:34.284173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:34.388493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b6194-6c8c-4aa4-b562-c2c5a7c65a08 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:34.425508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:34.426093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:34.426367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:34.426632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:34.427344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] RBAC: Adding query filter params (role.id=558419835357498886a96d0af76609b8, scope.project.id=9da472ca037646039c1242160b425b2f, user.id=fbe5765b3b7945e0b22c84c8ae57991c) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:34.427643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:34.429094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb19-a5bb-4609-8501-8d6b199ad675 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:34.435468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 565/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:34 2022] GET /identity/v3/role_assignments?user.id=fbe5765b3b7945e0b22c84c8ae57991c&scope.project.id=9da472ca037646039c1242160b425b2f&role.id=558419835357498886a96d0af76609b8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:36.339342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95290-b12f-4de1-bc9c-60b1963f7659 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:36.340293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95290-b12f-4de1-bc9c-60b1963f7659 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:36.340293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe95290-b12f-4de1-bc9c-60b1963f7659 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:36.342424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 566/1131] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:36.351036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:36.351454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:36.351582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:36.375289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:36.376525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:36.438904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:36.460655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 566/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:36.730784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe95290-b12f-4de1-bc9c-60b1963f7659 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:36.829465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:36.840592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe95290-b12f-4de1-bc9c-60b1963f7659 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:36.876272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:36.876973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:36.877250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:36.877496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:36.878699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:36.880176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907cc13-bd56-47c3-bd5e-c1a98b799b51 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:36.881747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 567/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:36.888038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:36.990311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d367776-a71a-47c4-9fdc-ada91fc014cd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:37.025729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:37.026327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:37.026605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:37.026878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:37.027534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:37.029000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77804d-4087-4bc5-a747-ac0b1d802326 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:37.063528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 567/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:10:36 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:38.972731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4447f16-87d1-4bb7-be81-8d99381b8a38 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:38.973581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4447f16-87d1-4bb7-be81-8d99381b8a38 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:38.973581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4447f16-87d1-4bb7-be81-8d99381b8a38 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:38.975802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 568/1135] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:38.983542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:38.984369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:38.984533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:39.010404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:39.011534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:39.041554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:39.084505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 568/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:39.350968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4447f16-87d1-4bb7-be81-8d99381b8a38 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:39.463809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4447f16-87d1-4bb7-be81-8d99381b8a38 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:39.499299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:39.499907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:39.500179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:39.500459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:39.501677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:39.503106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4ed45-a47e-4503-8504-6d730624f480 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:39.504671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 569/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:39.510765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:39.624939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e381d8-d0f2-40d3-ad5b-d2cb89da9ba2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:39.662595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:39.663204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:39.663477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:39.663743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:39.664429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:39.666284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12fcb-1325-4caa-8546-00cd3d80091e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:39.694875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 569/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:10:39 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:10:41.706957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd399e9-b1da-41ee-862c-f1e44a15dec8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:41.707545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd399e9-b1da-41ee-862c-f1e44a15dec8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:41.707545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd399e9-b1da-41ee-862c-f1e44a15dec8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:41.708884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 570/1139] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:41.715159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:41.715873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:41.716063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:41.742998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:41.744238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:41.759757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:41.816566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 570/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:42.093017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd399e9-b1da-41ee-862c-f1e44a15dec8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:42.126159 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:42.220881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd399e9-b1da-41ee-862c-f1e44a15dec8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:42.266131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:42.267020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:42.267945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:42.268252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:42.280449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:42.285690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:42.286845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:42.287903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 571/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:42.293677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:42.397393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da37ea6-20b1-4f5f-a7be-b72c6dc77528 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:42.432584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:42.433177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:42.433447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:42.433710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:42.434355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:42.434649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:42.436050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:42.444419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 571/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:42.450971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:42.549054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:42.565390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb686d3-151d-4b42-b27d-f46c862ffbfc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:42.605738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:42.606356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:42.606628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:42.606868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] PATH_INFO: `/v3/users/80388e3496f44341b2aaf3b71dc4000e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:42.621174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] RBAC: Authorizing `identity:get_user(user_id=80388e3496f44341b2aaf3b71dc4000e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:42.622626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:42.624245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 572/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:42 2022] GET /identity/v3/users/80388e3496f44341b2aaf3b71dc4000e => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:42.631303 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:42.648016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:42.741246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafdadb-409c-4e63-a1d0-11ad5ad4a507 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:42.780420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:42.781013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:42.781287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:42.781556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:42.850813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:42.852278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:42.865605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:42.954236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 572/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:42.960814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:43.063780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e644fa-35fc-4e79-843d-104801c31f53 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:43.099413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:43.100050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:43.100328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:43.100594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] PATH_INFO: `/v3/projects/d32b5b461cf749b6b0947d89be0df988` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:43.101813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] RBAC: Authorizing `identity:get_project(project_id=d32b5b461cf749b6b0947d89be0df988)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:43.103245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1ddf5-ef3d-4647-a912-0c2140c19627 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:43.104887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 573/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:42 2022] GET /identity/v3/projects/d32b5b461cf749b6b0947d89be0df988 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:43.111655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:43.216372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb258-4b56-4ef8-88c5-7e2aa5e91726 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:43.229422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:43.251807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:43.252430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:43.252709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:43.252973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:43.253690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=d32b5b461cf749b6b0947d89be0df988, user.id=80388e3496f44341b2aaf3b71dc4000e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:43.253990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:43.255407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c053897-be02-46d6-add3-ba36392de23d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:43.261224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 573/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:43 2022] GET /identity/v3/role_assignments?user.id=80388e3496f44341b2aaf3b71dc4000e&scope.project.id=d32b5b461cf749b6b0947d89be0df988&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:45.127553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700295-e990-4073-9c68-d7e7d1e50839 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:45.128151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700295-e990-4073-9c68-d7e7d1e50839 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:45.128151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a700295-e990-4073-9c68-d7e7d1e50839 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:45.129363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 574/1147] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:45.135829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:45.136486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:45.136700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:45.159114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:45.160344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:45.234780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 574/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:45.497422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700295-e990-4073-9c68-d7e7d1e50839 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:45.515776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:45.627004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a700295-e990-4073-9c68-d7e7d1e50839 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:45.666236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:45.666858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:45.667129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:45.667376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:45.677720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:45.682371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:45.683455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:45.684621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 575/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:45.691165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:45.797430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375f2f7-ff15-4f0e-84c1-1278ceaa641e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:45.804635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:45.837665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:45.838299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:45.838577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:45.838846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:45.839509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:45.839811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:45.841214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:45.849510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 575/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:45.858026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:45.954517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:45.989231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1cbfd-646e-4d0f-ab05-3ac5559a0484 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:46.025193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:46.025816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:46.026092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:46.026367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] PATH_INFO: `/v3/users/80388e3496f44341b2aaf3b71dc4000e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:46.027534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] RBAC: Authorizing `identity:get_user(user_id=80388e3496f44341b2aaf3b71dc4000e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:46.028999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:46.030577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 576/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:45 2022] GET /identity/v3/users/80388e3496f44341b2aaf3b71dc4000e => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:46.039891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:46.148169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43506c4a-cd48-4f75-b387-c383bcd52ff2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:46.182981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:46.183605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:46.183880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:46.184181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] PATH_INFO: `/v3/projects/d32b5b461cf749b6b0947d89be0df988` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:46.185345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] RBAC: Authorizing `identity:get_project(project_id=d32b5b461cf749b6b0947d89be0df988)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:46.186775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674d462-c8e1-4cb3-b02d-45431a937728 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:46.188451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 576/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:46 2022] GET /identity/v3/projects/d32b5b461cf749b6b0947d89be0df988 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:46.194976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:46.303103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804424ff-1d5f-4ad5-b5a6-a812ff9de24e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:46.338108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:46.338761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:46.339038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:46.339313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] PATH_INFO: `/v3/projects/d32b5b461cf749b6b0947d89be0df988/users/80388e3496f44341b2aaf3b71dc4000e/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:46.341490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] RBAC: Authorizing `identity:create_grant(project_id=d32b5b461cf749b6b0947d89be0df988, user_id=80388e3496f44341b2aaf3b71dc4000e, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:46.342940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409a9ce-64d2-4c66-8008-3c5b5b948732 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:46.359304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 577/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:10:46 2022] PUT /identity/v3/projects/d32b5b461cf749b6b0947d89be0df988/users/80388e3496f44341b2aaf3b71dc4000e/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:10:48.208490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28709dd-1192-4070-b04f-a69a2b1dbe0e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:48.209079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28709dd-1192-4070-b04f-a69a2b1dbe0e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:48.209079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28709dd-1192-4070-b04f-a69a2b1dbe0e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:48.210394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 577/1154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:48.216820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:48.217512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:48.217817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:48.229707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:48.247099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:48.248331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:48.326344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 578/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:48.599120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28709dd-1192-4070-b04f-a69a2b1dbe0e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:48.639391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:48.710310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28709dd-1192-4070-b04f-a69a2b1dbe0e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:48.753317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:48.753945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:48.754219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:48.754480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:48.765651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:10:48.770673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:48.771733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:10:48.772828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 578/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:48.780256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:48.883384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22398d55-4e65-4996-8a74-6a70418ca31b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:48.913476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:48.920487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:48.921085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:48.921362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:48.921626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:48.922289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:48.922586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:48.924034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:48.932073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 579/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:48.938093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:49.035305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:49.042466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6bd90-1ad4-4402-8bb7-af7e5f8ed98d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:49.077646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:49.078259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:49.078530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:49.078802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] PATH_INFO: `/v3/users/80388e3496f44341b2aaf3b71dc4000e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:49.080221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] RBAC: Authorizing `identity:get_user(user_id=80388e3496f44341b2aaf3b71dc4000e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:49.081641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:49.083232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 579/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:10:48 2022] GET /identity/v3/users/80388e3496f44341b2aaf3b71dc4000e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:49.089223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:49.198692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9d64-f737-4693-9144-51e56cf049fe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:49.232764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:49.233354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:49.233623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:49.233888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:49.295462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:49.303611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:49.305090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:49.419182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 580/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:49.426089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:49.544932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260775dd-3e04-4ef4-90a0-f59541f042b3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:49.579638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:49.580266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:49.580541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:49.580803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] PATH_INFO: `/v3/projects/d32b5b461cf749b6b0947d89be0df988` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:49.582035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d32b5b461cf749b6b0947d89be0df988)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:49.583459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd05e-11d7-4a6b-8d94-180e54b148a9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:49.585096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 580/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:10:49 2022] GET /identity/v3/projects/d32b5b461cf749b6b0947d89be0df988 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:49.594253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:49.697154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:49.704785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f08-e131-48f6-baa1-6cdcd0cbe38a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:49.741801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:49.742421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:49.742697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:49.742967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:49.743701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=d32b5b461cf749b6b0947d89be0df988, user.id=80388e3496f44341b2aaf3b71dc4000e) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:49.744041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:49.745477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd8bbf-4999-4c0c-b754-fbf5b4420db3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:49.751833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 581/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:10:49 2022] GET /identity/v3/role_assignments?user.id=80388e3496f44341b2aaf3b71dc4000e&scope.project.id=d32b5b461cf749b6b0947d89be0df988&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:10:51.693403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352af5-9318-4476-aba5-abed33260a71 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:51.693986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352af5-9318-4476-aba5-abed33260a71 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:51.693986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352af5-9318-4476-aba5-abed33260a71 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:51.696035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 581/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:51.703961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:51.704690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:51.704975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:51.726433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:51.726970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:51.800668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 582/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:10:52.075616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69352af5-9318-4476-aba5-abed33260a71 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:52.114511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:52.192264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69352af5-9318-4476-aba5-abed33260a71 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:52.227174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:52.227766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:52.228120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:52.228384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:52.302266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:52.303716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:52.334031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:52.403296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 582/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:10:52.411261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:52.502374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:52.517547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62645d9-57b3-4e07-b6b2-543b113249ac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:52.557400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:52.558028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:52.558309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:52.558577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:52.565340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:52.566791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-06fea3c9-db17-4698-ba11-a71a79c5fa74 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:10:52.578071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:10:52.579336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:10:52.580657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 583/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:10:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:10:52.587298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:52.692744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb2670-3219-46df-b9b8-b0f1252dfeed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:52.724958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:52.733999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:52.734608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:52.734887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:52.735221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:52.735869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:10:52.736211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:52.737582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d17859-cf37-4f51-88a2-9751898c0d4b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:52.745178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 583/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 17 11:10:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:54.617476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd6ad-d566-47c6-8edb-0175b577cf09 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:54.618359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd6ad-d566-47c6-8edb-0175b577cf09 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:54.618359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd6ad-d566-47c6-8edb-0175b577cf09 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:54.621466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 584/1167] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:54.631522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9416f-b8ea-4af8-97a9-909e6eb7cbdf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:54.632293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9416f-b8ea-4af8-97a9-909e6eb7cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:54.632419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9416f-b8ea-4af8-97a9-909e6eb7cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:54.660313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4aa9416f-b8ea-4af8-97a9-909e6eb7cbdf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:54.661509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4aa9416f-b8ea-4af8-97a9-909e6eb7cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:54.739705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 584/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:55.020843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd6ad-d566-47c6-8edb-0175b577cf09 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:55.132597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd6ad-d566-47c6-8edb-0175b577cf09 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:55.175650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:55.176270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:55.176544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:55.176807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:55.177450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:55.178812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990235c7-a548-4ef7-91cb-533e798db58d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:55.196833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 585/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Aug 17 11:10:55 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:57.168208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c6ac-8f02-436c-8770-257254196399 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:57.168767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c6ac-8f02-436c-8770-257254196399 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:57.168767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c6ac-8f02-436c-8770-257254196399 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:57.170112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 585/1170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:57.177035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:57.177714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:57.177861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:57.207524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:57.208745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:57.210746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:57.280083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 586/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:10:57.555562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c6ac-8f02-436c-8770-257254196399 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:57.678957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c6ac-8f02-436c-8770-257254196399 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:57.704719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:57.716138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:57.716767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:57.717042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:57.717307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] PATH_INFO: `/v3/domains/e1551f54bdc2434cb2b80030e5a9a36b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:57.729861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1551f54bdc2434cb2b80030e5a9a36b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:57.732226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145a04f-c801-43f4-8111-0c6108c4e5d4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:57.734787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 586/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 17 11:10:57 2022] GET /identity/v3/domains/e1551f54bdc2434cb2b80030e5a9a36b => generated 267 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:10:57.743198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:10:57.849761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150476c-e36c-4f28-ba3a-5aa3abc819cc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:10:57.884784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:10:57.885387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:57.885663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:57.885934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:57.886568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:10:57.888041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebdaa0-114c-4ebe-999e-6232c0081f7d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:10:57.897835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:10:57.918549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 587/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:10:57 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:10:59.816843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32f70-1c8c-4279-b802-01b95646d342 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:59.817704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32f70-1c8c-4279-b802-01b95646d342 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:59.817704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32f70-1c8c-4279-b802-01b95646d342 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:59.819974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 587/1174] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:10:59.826071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:10:59.826798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:10:59.826939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:10:59.852290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:10:59.853485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:10:59.921891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 588/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:11:00.194920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a32f70-1c8c-4279-b802-01b95646d342 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:00.322146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a32f70-1c8c-4279-b802-01b95646d342 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:00.360266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:00.360897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:00.361170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:00.361440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] PATH_INFO: `/v3/domains/e1551f54bdc2434cb2b80030e5a9a36b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:00.362767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=e1551f54bdc2434cb2b80030e5a9a36b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:00.364228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5749-42b3-4ddc-8c55-fbbcd84cd19d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:00.365811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 588/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 17 11:11:00 2022] GET /identity/v3/domains/e1551f54bdc2434cb2b80030e5a9a36b => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:00.371956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:00.485316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0514f-b14a-4081-8508-9d37793ef2b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:00.506017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:00.523174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:00.523767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:00.524069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:00.524334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:00.524967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:00.526398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfba1d1-0595-45e3-87e4-2c47e848e004 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:00.548069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 589/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:11:00 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:11:02.490191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c75f2-ee57-4e27-9d72-34a1492f2eb1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:02.490822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c75f2-ee57-4e27-9d72-34a1492f2eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:02.490822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c75f2-ee57-4e27-9d72-34a1492f2eb1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:02.492124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 589/1178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:11:02.498416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:02.499202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:02.499338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:02.524331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:11:02.525506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:11:02.598418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 590/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:11:02.871703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c75f2-ee57-4e27-9d72-34a1492f2eb1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:02.934771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:02.987624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c75f2-ee57-4e27-9d72-34a1492f2eb1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:03.022731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:03.023351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:03.023628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:03.023898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:03.034907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:11:03.039949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:11:03.041089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:11:03.041994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 590/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:11:03.047473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:03.153456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeaf22-01a3-430f-8a21-4184d101c351 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:03.161659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:03.191447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:03.192086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:03.192326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:03.192616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:03.193285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:11:03.193585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:03.194969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:03.203168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 591/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:03.209166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:03.317971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156a0f5-b5a6-4465-8f64-df38aa0e542d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:03.331290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:03.355939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:03.356976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:03.357424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:03.357816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] PATH_INFO: `/v3/users/a439b9c35962421da819c4ceec35be08` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:03.373216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] RBAC: Authorizing `identity:get_user(user_id=a439b9c35962421da819c4ceec35be08)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:03.374667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:03.376431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 591/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:11:03 2022] GET /identity/v3/users/a439b9c35962421da819c4ceec35be08 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:03.382705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:03.492191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6062-d609-4179-9cb2-a22cb7b03057 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:03.526833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:03.527443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:03.527684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:03.527956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:03.564418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:03.607443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:03.608944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:03.710585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 592/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:11:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 11:11:03.716918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:03.839795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40708192-703e-4955-a3b8-475e4d226024 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:03.875458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:03.876109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:03.876387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:03.876656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] PATH_INFO: `/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:03.877833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] RBAC: Authorizing `identity:get_project(project_id=4c892fbf42654ad0b7b572f52eb57b7b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:03.879260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb3e1c-fbdc-49c7-abfa-268286636b5c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:03.881074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 592/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:11:03 2022] GET /identity/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:03.887604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:03.962900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:04.003219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc9e19-f0a5-471a-a111-632353c76965 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:04.040270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:04.040864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:04.041140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:04.041394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:04.042116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=4c892fbf42654ad0b7b572f52eb57b7b, user.id=a439b9c35962421da819c4ceec35be08) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:11:04.042420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:04.043866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb267f6-ff92-43e5-a33b-cbd14cf3db8e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:04.050485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 593/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:11:03 2022] GET /identity/v3/role_assignments?user.id=a439b9c35962421da819c4ceec35be08&scope.project.id=4c892fbf42654ad0b7b572f52eb57b7b&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:05.915962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767afd-bd55-4560-a45a-021faba7bbb4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:05.916786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767afd-bd55-4560-a45a-021faba7bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:05.916898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767afd-bd55-4560-a45a-021faba7bbb4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:05.919007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 593/1186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:11:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:11:05.925251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:05.925950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:05.926094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:05.949478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:11:05.950679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:11:06.031985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 594/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:11:06.307240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767afd-bd55-4560-a45a-021faba7bbb4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:06.353986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:06.425108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767afd-bd55-4560-a45a-021faba7bbb4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:06.460307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:06.460922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:06.461195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:06.461466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:06.472498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:11:06.477178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:11:06.478249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:11:06.479346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 594/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:11:06.485254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:06.562528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:06.608646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c336-0081-45e3-97d3-63ca3d584182 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:06.647119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:06.647751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:06.648057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:06.648335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:06.649043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:11:06.649348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:06.650729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:06.658924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 595/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:06.665381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:06.775643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:06.778859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c42e34-3883-4786-b5e9-e88a03702073 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:06.817768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:06.818311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:06.818589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:06.818857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] PATH_INFO: `/v3/users/a439b9c35962421da819c4ceec35be08` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:06.820068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] RBAC: Authorizing `identity:get_user(user_id=a439b9c35962421da819c4ceec35be08)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:06.821508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:06.823080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 595/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:11:06 2022] GET /identity/v3/users/a439b9c35962421da819c4ceec35be08 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:06.829785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:06.942650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3bd5-8487-4f45-b24a-d74ddc12b9e5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:06.966175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:06.977798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:06.978415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:06.978672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:06.978936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] PATH_INFO: `/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:06.980105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] RBAC: Authorizing `identity:get_project(project_id=4c892fbf42654ad0b7b572f52eb57b7b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:06.981535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b72ca-c2e6-4f36-8158-696da9db8e22 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:06.983153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 596/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:11:06 2022] GET /identity/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:06.989385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:07.095771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723abfaa-e578-49dd-a4c2-33b97bde3021 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:07.130669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:07.131300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:07.131568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:07.131834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] PATH_INFO: `/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b/users/a439b9c35962421da819c4ceec35be08/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:07.133970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] RBAC: Authorizing `identity:create_grant(project_id=4c892fbf42654ad0b7b572f52eb57b7b, user_id=a439b9c35962421da819c4ceec35be08, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:07.135377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92498088-475e-4dc0-89ee-69502395ddfc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:07.151163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 596/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:11:06 2022] PUT /identity/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b/users/a439b9c35962421da819c4ceec35be08/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:11:08.999876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d515-6f48-4ec9-99dd-483dd41bc4a7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:09.000458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d515-6f48-4ec9-99dd-483dd41bc4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:09.000458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791d515-6f48-4ec9-99dd-483dd41bc4a7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:09.001673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 597/1193] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:11:09.006931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:09.007378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:09.007485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:09.026277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:11:09.027473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:11:09.052908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:09.097772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 597/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:11:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:11:09.371823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d515-6f48-4ec9-99dd-483dd41bc4a7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:09.488287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791d515-6f48-4ec9-99dd-483dd41bc4a7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:09.535663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:09.536481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:09.536770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:09.537025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:09.548299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:11:09.552910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:11:09.553997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:11:09.554936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 598/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:11:09.560317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:09.665148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064c8e1-6891-4a38-a775-88a802778285 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:09.700441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:09.701041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:09.701309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:09.701573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:09.702231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:11:09.702580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:09.703951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:09.712076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 598/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:11:09.720807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:09.781937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:09.839738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1da3ab-2bce-4567-90c3-7af0382474e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:09.879724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:09.880706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:09.881094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:09.881474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] PATH_INFO: `/v3/users/a439b9c35962421da819c4ceec35be08` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:09.883460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] RBAC: Authorizing `identity:get_user(user_id=a439b9c35962421da819c4ceec35be08)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:09.885800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:09.888309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 599/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 17 11:11:09 2022] GET /identity/v3/users/a439b9c35962421da819c4ceec35be08 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:11:09.894903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:09.919271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:10.002380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528bcc-93c1-4d6d-8788-1f5cbcf0121f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:10.041777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:10.042423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:10.042667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:10.042937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:10.111683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:10.113164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:10.135113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:10.218568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 599/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:11:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:11:10.225449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:10.336414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3d2ba-981e-4c3c-95a1-a03aee47618a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:10.356972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:10.372892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:10.373511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:10.373783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:10.374049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] PATH_INFO: `/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:10.375481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] RBAC: Authorizing `identity:get_project(project_id=4c892fbf42654ad0b7b572f52eb57b7b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:10.376953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c72fb-0159-4762-9a4c-72ffeda0cad6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:10.378546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 600/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 17 11:11:10 2022] GET /identity/v3/projects/4c892fbf42654ad0b7b572f52eb57b7b => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:10.385086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:11:10.504702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb348679-274d-40ed-b6f2-ba00ef259fd4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:11:10.526522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:10.544687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:11:10.545285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:11:10.545557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:11:10.545825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:11:10.546716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=4c892fbf42654ad0b7b572f52eb57b7b, user.id=a439b9c35962421da819c4ceec35be08) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:11:10.547028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:11:10.548493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14884-f81f-414b-8136-b3781e04964e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:11:10.554616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 600/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:11:10 2022] GET /identity/v3/role_assignments?user.id=a439b9c35962421da819c4ceec35be08&scope.project.id=4c892fbf42654ad0b7b572f52eb57b7b&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:11:20.367926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:11:20.551579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:06.317623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233419ab-7aa4-41db-b496-a38b84f184f5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:06.318213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233419ab-7aa4-41db-b496-a38b84f184f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:06.318213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233419ab-7aa4-41db-b496-a38b84f184f5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:06.319648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 601/1201] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:06.326822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:06.327369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:06.327369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:06.349992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:06.351510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:06.442983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 601/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:06.722079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233419ab-7aa4-41db-b496-a38b84f184f5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:06.859881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233419ab-7aa4-41db-b496-a38b84f184f5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:06.900933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:06.901792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:06.902133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:06.902345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:06.915298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:06.917563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:06.934506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:06.936119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:06.937099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:06.937099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:06.937099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:06.937099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 602/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:06.942533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:07.071689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be1e85-8240-421b-ae78-330c98869bfc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:07.105360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:07.112482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:07.113105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:07.113391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:07.113660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:07.114309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:07.114603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:07.115996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb190342-4650-4e8d-90a0-a75e04538baa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:07.131978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 602/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:07.135006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:07.198257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:07.255654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ea33-9d46-4d54-9478-6747b717acef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:07.297722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:07.298320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:07.298592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:07.298864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:07.299515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:07.301140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc234428-b2d2-4520-a311-ab0ed2df489b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:07.332068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 603/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 17 11:12:07 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:12:09.466973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7cbb-4294-4212-984a-1aded32acc9f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:09.468911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7cbb-4294-4212-984a-1aded32acc9f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:09.468911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7cbb-4294-4212-984a-1aded32acc9f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:09.469317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 603/1206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:09.475114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:09.475609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:09.475725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:09.494280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:09.495748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:09.575203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 604/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:09.838065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b7cbb-4294-4212-984a-1aded32acc9f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:09.956650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b7cbb-4294-4212-984a-1aded32acc9f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:09.997715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:09.998356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:09.998644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:09.998911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.010852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:10.015877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:10.016893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:10.020794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 604/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:10.023470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:10.070357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:10.139380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32946bb2-0461-4bb1-9fca-8dd9322015c6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:10.187372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:10.188033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:10.188313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:10.188645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.189373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:10.189829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:10.191268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:10.201934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 605/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:10.209120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:10.266678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:10.329952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3ec72-c402-47bc-ba5c-1e3d7daedb67 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:10.369549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:10.370288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:10.370598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:10.370866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.387016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:10.388559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:10.406169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:10.407372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:10.409045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:10.409045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:10.409045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:10.409045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 605/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:12:10.414003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:10.529798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:10.533567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b654a1-bae9-489b-8200-f2bda3460109 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:10.577282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:10.577954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:10.578237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:10.578511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.579323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:10.579665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:10.581354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:10.600533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 606/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:10.602033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:10.710421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32dd0e-acfb-484f-b0dd-f777734ac2f5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:10.712049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:10.749906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:10.750554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:10.750853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:10.751122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.758945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:10.760594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:10.773198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:10.774207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:10.775235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 606/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:10.781041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:10.904625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e1f8-8221-4d4d-b78f-5aec1ee4c33e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:10.944765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:10.945378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:10.945649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:10.945915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:10.946710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:10.947013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:10.948531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:10.968205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 607/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:10.976976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:11.103012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e3ed6-3b47-4287-a098-196a561852a5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:11.141608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:11.142486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:11.142810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:11.143017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:11.184783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:11.238163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:11.239872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:11.368320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 607/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:12:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:12:11.374947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:11.399840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:11.502384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cc00b-dd01-42ef-b714-a3bb05ffebd2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:11.543228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:11.543953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:11.544205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:11.544601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:11.556866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:11.558583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:11.578876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:11.580855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:11.581757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:11.581757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:11.581757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:11.581757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 608/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:12:11.588023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:11.654495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:11.695703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c9991-77ca-49d1-9b7a-40155b8c0ad5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:11.740779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:11.741401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:11.741676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:11.741943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:11.742590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:11.742888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:11.744309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:11.756513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 608/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:11.762140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:11.848697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:11.887202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ed0ac-c37c-42aa-97d6-e6f292d111a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:11.923038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:11.923626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:11.923908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:11.924203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:11.931039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:11.932940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:11.944228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:11.945409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:11.946619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:11.948372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 609/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:11.951716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:12.064225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942681c1-c640-4727-9c09-784926ee0f33 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:12.089769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:12.104565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:12.105358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:12.105750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:12.106169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:12.107023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:12.107499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:12.109173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2983a-4988-44fa-9398-c4287096c4ab None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:12.125168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 609/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:12.131663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:12.264681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc186f7-8859-4dca-8cae-fb0f7ea177c4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:12.295429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:12.301978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:12.302890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:12.303223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:12.303718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:12.304575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=e843df35ed704a3db7b73ee7678cb4e1) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:12.304915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:12.306662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5278a-d036-42ac-bedc-0892f60e4ae9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:12.312778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 610/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:12:12 2022] GET /identity/v3/role_assignments?user.id=e843df35ed704a3db7b73ee7678cb4e1&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:14.234886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccde7a-90d2-423d-8e0f-7986b10f629d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:14.235486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccde7a-90d2-423d-8e0f-7986b10f629d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:14.235486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccde7a-90d2-423d-8e0f-7986b10f629d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:14.236839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 610/1220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:14.242218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:14.242725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:14.242838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:14.261291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:14.262473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:14.348812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 611/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:14.628774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccde7a-90d2-423d-8e0f-7986b10f629d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:14.744600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccde7a-90d2-423d-8e0f-7986b10f629d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:14.779344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:14.780029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:14.780324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:14.780600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:14.791466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:14.796250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:14.797393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:14.798594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 611/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:14.803590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:14.911243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072906e-488a-49cd-bdbe-f606f63cc0ac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:14.936299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:14.948225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:14.948998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:14.949368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:14.949769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:14.950600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:14.950872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:14.952353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:14.961366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 612/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:14.967555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.015412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:15.071859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e0df-7b83-4b0b-8c27-b9da4dacd310 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.109880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:15.110548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:15.110839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:15.111093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:15.121612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:15.123062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:15.137703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:15.138879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:15.139960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:15.139960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:15.139960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:15.139960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 612/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:15.145697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.258500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae9a2-d31e-49a4-8d72-b342cda98ebe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.296952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:15.297610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:15.297887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:15.298153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:15.298816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:15.299112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:15.300523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:15.312492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 613/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:15.318727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.420944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:15.428977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba341a9-ba8c-4b60-87a5-16670887b8a5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.466084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:15.466721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:15.467002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:15.467270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:15.474817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:15.476298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:15.488121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:15.489322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:15.490251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 613/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:15.495599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.552045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:15.608948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a5d-8b8a-4b28-a2b9-092697230110 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.653323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:15.653935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:15.654199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:15.654495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:15.655264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:15.655597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:15.657199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:15.675830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 614/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:15.681384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.793780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa9785-790d-41a3-81b7-dd77a10bfb4b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.832977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:15.833488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:15.833865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:15.834261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:15.848403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:15.849950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:15.866087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:15.867283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:15.869074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:15.869074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:15.869074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:15.869074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 614/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:15.874282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:15.987740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75200176-2424-441e-ad76-1ac02d9347ca None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:15.990694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:16.027805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:16.028445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:16.028719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:16.028988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:16.029625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:16.029919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:16.031293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:16.044028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 615/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:16.051018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:16.063281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:16.171827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc172e-dd17-45c8-89d9-324e7a8642b8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:16.219075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:16.219835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:16.220153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:16.220540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:16.229020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:16.231098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:16.244953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:16.246389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:16.247413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 615/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:16.253187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:16.382431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed0bb-e18c-4742-8a84-06f7a899ed7f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:16.424371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:16.424875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:16.425148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:16.425490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:16.426109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:16.426440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:16.428084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb01f7-345d-4fd7-9c3d-0f0ea1dc23dd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:16.441517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 616/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:16.448240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:16.519341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:16.557424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7828092-fdd2-4733-bf3a-8eb3579fc28c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:16.594977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:16.595666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:16.595945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:16.596230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/e843df35ed704a3db7b73ee7678cb4e1/roles/c4cea236f0db41cd92f9159834f52b0b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:16.611599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=e843df35ed704a3db7b73ee7678cb4e1, role_id=c4cea236f0db41cd92f9159834f52b0b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:16.613069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9fcd6-0e30-44da-9a85-8576e844e7ba None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:16.628249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 616/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:12:16 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/e843df35ed704a3db7b73ee7678cb4e1/roles/c4cea236f0db41cd92f9159834f52b0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:12:18.679007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9faf0-c8cf-45cc-8c7e-114c2ed101fd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:18.679586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9faf0-c8cf-45cc-8c7e-114c2ed101fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:18.679586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9faf0-c8cf-45cc-8c7e-114c2ed101fd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:18.680957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 617/1233] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:18.686691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:18.687119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:18.687228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:18.705596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:18.706888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:18.781055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 617/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:19.052340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9faf0-c8cf-45cc-8c7e-114c2ed101fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:19.082202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:19.174321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9faf0-c8cf-45cc-8c7e-114c2ed101fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:19.213335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:19.214031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:19.214315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:19.214602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:19.226328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:19.231607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:19.232831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:19.233672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 618/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:19.238970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:19.290130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:19.348438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d4568-b954-4821-8c53-84770d0ed22d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:19.388944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:19.389669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:19.390062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:19.390333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:19.391189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:19.391560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:19.393172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:19.407986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 618/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:19.409500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:19.512897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:19.530231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d2177-1fdc-4ae8-be31-7274b64a2100 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:19.569318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:19.569948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:19.570222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:19.570487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:19.581522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:19.582985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:19.597927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:19.599071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:19.600082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:19.600082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:19.600082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:19.600082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 619/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:19.605477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:19.714652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dce512-3fe8-43f7-a0ce-9c86beaa80e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:19.727442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:19.755817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:19.756472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:19.756763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:19.757030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:19.757760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:19.758062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:19.759435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:19.774863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 619/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:19.780810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:19.898623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2163cc2-6345-4bc7-a372-481b2e661639 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:19.936217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:19.936839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:19.937115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:19.937418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:19.940473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:19.946342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:19.947946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:19.959432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:19.961094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:19.962679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 620/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:19.966730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:20.075601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dfec5-860c-429f-8df8-14a222a231f3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:20.111144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:20.111768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:20.112080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:20.112377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:20.113179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:20.113488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:20.115018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:20.134382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 620/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:20.140794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:20.259592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457eeb99-3a8b-46ba-91ee-88eb62e63248 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:20.299332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:20.300058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:20.300437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:20.300747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:20.372988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:20.382060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:20.383665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:20.492553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 621/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:12:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:12:20.498445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:20.531841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:20.611457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565999-4216-4891-b10c-1cf77433347e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:20.650083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:20.650674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:20.651024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:20.651365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:20.663203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:20.664834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:20.679992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:20.681140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:20.682285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:20.682285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:20.682285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:20.682285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 621/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:20.687129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:20.793756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:20.800344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a5adc-245e-4b59-9f80-4263cad30a1a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:20.838793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:20.839400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:20.839707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:20.840025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:20.840725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:20.841048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:20.842485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:20.855095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 622/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:20.860943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:20.946663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:20.971892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d545-7929-4939-b322-e77e9d5a7153 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:21.009406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:21.010185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:21.010441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:21.010710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:21.018805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:21.020439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:21.033506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:21.034630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:21.035847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 622/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:21.041090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:21.148085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135c1b3-fc66-44aa-bb9c-a060893b3220 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:21.191128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:21.191833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:21.192150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:21.192448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:21.193242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:21.193548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:21.195183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6019b4-6583-4adf-9e97-250631fddb33 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:21.211231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 623/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:21.217504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:21.328615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1c7b-5c53-47b2-aab9-5ca6f79d404c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:21.364032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:21.364935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:21.364935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:21.365198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:21.365920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] RBAC: Adding query filter params (role.id=c4cea236f0db41cd92f9159834f52b0b, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=e843df35ed704a3db7b73ee7678cb4e1) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:21.366220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:21.367706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d8aa-8f7a-4e45-941e-0b819baed925 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:21.374292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 623/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:12:21 2022] GET /identity/v3/role_assignments?user.id=e843df35ed704a3db7b73ee7678cb4e1&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=c4cea236f0db41cd92f9159834f52b0b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:23.432572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f34d-68d5-4a4f-b28c-ec77fff5f3bb None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:23.433305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f34d-68d5-4a4f-b28c-ec77fff5f3bb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:23.433305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f34d-68d5-4a4f-b28c-ec77fff5f3bb None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:23.434852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 624/1247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:23.440417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:23.440905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:23.441123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:23.449087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:23.464705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:23.466095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:23.550170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 624/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:12:23.855127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f34d-68d5-4a4f-b28c-ec77fff5f3bb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:23.875708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:23.972711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f34d-68d5-4a4f-b28c-ec77fff5f3bb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.013288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.013997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.014354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.014646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.028113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:24.033448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:24.034558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:24.035873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 625/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:24.042055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:24.163199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4135c47-c9d8-4b49-bb7d-637a3bc30167 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.219118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:24.225722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.226546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.226875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.227139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.228174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:24.228618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:24.230039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:24.238995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 625/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:24.245085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:24.325661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:24.350383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9541-9b9f-4869-97c0-889bde238a33 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.387859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.388490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.388760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.389024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.400704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:24.402435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:24.420449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:24.422767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:24.423895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:24.423895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:24.423895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:24.423895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 626/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:12:24.428523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:24.540070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1c3fe-ed40-444a-88a5-25cad801cf00 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.577571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.578105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.578379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.579171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.579647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:24.580005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:24.581529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:24.594365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 626/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:24.600848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:24.719823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff691-04f9-42f4-bef2-e52b510b7321 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.749962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:24.760397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.761178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.761466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.761734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.771275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:24.772749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:24.787437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:24.789442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:24.790882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:24.798778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 627/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:12:24.800083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:24.860193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:24.913528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681b240-888a-4600-9f8d-76e9396fb4cd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:24.953304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:24.954008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:24.954354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:24.954689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:24.955491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:24.955864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:24.957386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:24.981397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 627/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:24.982780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:25.100795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ccc27-70d7-4643-8b63-1b67b4f1725b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:25.141485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:25.142107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:25.142385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:25.142659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:25.214540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:25.238764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:25.240673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:25.355705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 628/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:12:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:12:25.356985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:25.474060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf0ec-1ba4-44b0-9d8d-5b498f106f5a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:25.489936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:25.516688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:25.517318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:25.517597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:25.517865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:25.528985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:25.530484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:25.546908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:25.548485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:25.549358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:25.549358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:25.549358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:25.549358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 628/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:25.553967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:25.666441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:25.685845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87ce1-b0f5-4584-8b31-d2bafe5a462d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:25.731645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:25.732211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:25.732567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:25.732929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:25.733943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:25.733943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:25.735621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:25.749137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 629/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:25.754891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:25.858861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dff7c-c269-450d-90f4-059a20723049 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:25.897712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:25.898414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:25.898698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:25.898971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:25.907520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:25.909428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:25.923159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:25.924402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:25.925311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 629/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:25.930657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:26.044712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186e574-fc31-4d14-ad56-1e894bb0d311 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:26.080825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:26.081408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:26.081676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:26.081941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:26.082653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:26.082922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:26.084394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b0244-5f1b-4bf0-b87b-441582e72da1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:26.096509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 630/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:26.102897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:26.130762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:26.222870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c5d0-4cb0-45d5-931f-34fafe15c737 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:26.261069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:26.261758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:26.262104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:26.262377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:26.263256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=e843df35ed704a3db7b73ee7678cb4e1) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:26.263572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:26.265382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8b821-d286-49f9-ae2a-0d05e354c6b9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:26.283960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 630/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:12:26 2022] GET /identity/v3/role_assignments?user.id=e843df35ed704a3db7b73ee7678cb4e1&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:28.163071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8b70-0411-4f32-bf40-36481aa52032 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:28.163734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8b70-0411-4f32-bf40-36481aa52032 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:28.163734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8b70-0411-4f32-bf40-36481aa52032 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:28.165283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 631/1261] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:28.170561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:28.170993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:28.171109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:28.194013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:28.195702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:28.264788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 631/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 11:12:28.528524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8b70-0411-4f32-bf40-36481aa52032 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:28.547205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:28.652113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8b70-0411-4f32-bf40-36481aa52032 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:28.689408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:28.690026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:28.690300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:28.690569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:28.701537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:28.706185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:28.707225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:28.709094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 632/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:28.714489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:28.735030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:28.818550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93595-efbe-4d46-b7f9-75733046120d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:28.855285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:28.855880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:28.856188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:28.856459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:28.857122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:28.857427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:28.858788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:28.866878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 632/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:28.872918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:28.949160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:28.985475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496d08-3beb-47b1-8487-dcb913ef9dd3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.023178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.023796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.024093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.024384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.034605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.036394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:29.050812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:29.051881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:29.052982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:29.052982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:29.052982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:29.052982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 633/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:29.058022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.142822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:29.174709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf53a-0ff5-4e84-b671-cb28c11f4996 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.216588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.217196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.217494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.217760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.218397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:29.218694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.220083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.231792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 633/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:29.237714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.349652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d574c9-489f-447e-a709-2adf372463e3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.368881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:29.384296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.384917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.385191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.385458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.393451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.394824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:29.406480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:29.408719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:29.410294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 634/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:29.413829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.518698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd01c92-46ce-458a-92be-80622feaa9c4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.553769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.554362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.554636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.554909 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.555661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:29.556099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.557524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.566166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:29.577186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 634/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:29.582946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.695340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bd8e3-0c37-4a22-89bf-fcad1ef17bd6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.733846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.734497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.734772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.735044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.746917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.748418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:29.764144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:29.770004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:29.771071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:29.771071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:29.771071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:29.771071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 635/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:29.771361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.874814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b02e02-b7a7-4c97-96a7-75a41d11fa39 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:29.910329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:29.910916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:29.911186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:29.911451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:29.912110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:29.912409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:29.913755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:29.924922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 635/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:29.932888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:29.967894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:30.043891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8549c-2002-4ccd-adb6-823eafb23e38 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:30.079716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:30.080367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:30.080641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:30.080913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:30.088095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:30.089539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:30.101080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:30.102078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:30.103102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 636/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:30.110304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:30.187090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:30.235097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd5f1-cc1c-4c86-aba2-b945414e89f0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:30.271775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:30.272404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:30.272677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:30.272948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:30.273656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:30.273974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:30.275526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fefda1-57b9-43e8-90d3-f9a16941ae6a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:30.287620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 636/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:30.294627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:30.404920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:30.416003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fa417-dcc4-4d67-a64f-d6b2750eb479 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:30.452540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:30.453186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:30.453458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:30.453728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] PATH_INFO: `/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/e843df35ed704a3db7b73ee7678cb4e1/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:30.455859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b0d96bb0c457e997d586501fbb618, user_id=e843df35ed704a3db7b73ee7678cb4e1, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:30.457329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c85085-77a9-48b3-ac85-59540030a298 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:30.476479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 637/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 17 11:12:30 2022] PUT /identity/v3/projects/0f2b0d96bb0c457e997d586501fbb618/users/e843df35ed704a3db7b73ee7678cb4e1/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:12:32.375651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3b7c5-790b-4d93-a9a5-271a849d0b22 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:32.376620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3b7c5-790b-4d93-a9a5-271a849d0b22 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:32.376620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3b7c5-790b-4d93-a9a5-271a849d0b22 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:32.378502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 637/1274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:32.384504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:32.384963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:32.385055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:32.405233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:32.406409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:32.480268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 638/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:32.754876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3b7c5-790b-4d93-a9a5-271a849d0b22 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:32.867009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3b7c5-790b-4d93-a9a5-271a849d0b22 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:32.884260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:32.904430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:32.905068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:32.905343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:32.905603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:32.917846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 11:12:32.922619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:32.927484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:32.928622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 638/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 17 11:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:32.930295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.025259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:33.049516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c299f8-06e3-49ce-8682-b93de41deeaa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.087619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.088262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.088541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.088810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:33.089475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:33.089776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:33.091157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:33.099283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 639/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 17 11:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:33.106026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.219515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1867f-eef4-40fd-b519-8d77241114bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.261694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.262684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.263108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.263535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:33.282133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:33.284806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:33.301875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:33.303001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:33.303953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:33.303953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:33.303953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:33.303953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 639/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:33.309396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.421022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c52345-72b0-44db-9512-61a1584d0ba3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.456361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.456951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.457225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.457494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:33.458128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:33.458425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:33.459793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:33.471681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 640/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:33.480469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.512703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:33.595714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db9e9-b7dd-4cea-8122-ba8ed5d16836 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.629834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.630441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.630695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.630984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:33.638593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:33.640050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 11:12:33.651220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:33.652358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:33.653528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 640/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:33.658924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.665450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:33.783451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2ec7-1eaa-4c98-9bf0-23967810d198 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.819758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.820383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.820662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.821079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:33.821804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:33.822112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:33.823548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:33.841351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 641/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 17 11:12:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:33.847574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:33.947543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:33.958317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a51d-d2ac-409e-8e36-cfbf7e5f2471 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:33.993452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:33.994042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:33.994319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:33.994590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:34.061367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:34.062812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:34.147862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:34.162264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 641/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 17 11:12:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 11:12:34.168830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:34.240212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:34.291819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4699ff1-c917-4874-bc98-30c78481f333 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:34.328864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:34.329485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:34.329762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:34.330028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:34.340701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:34.342143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 11:12:34.356807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:34.357979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 11:12:34.359474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 11:12:34.359474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 11:12:34.359474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:34.359474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 642/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 11:12:34.367278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:34.465693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d14247-a0c5-4279-ba0c-59c57634cfd1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:34.501278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:34.503726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:34.504031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:34.504299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:34.504934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:34.505232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:34.506581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:34.517742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 642/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 17 11:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:34.523801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:34.632288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5e6c-e725-4125-b295-ac29a835b8c2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:34.645953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:34.668279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:34.668892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:34.669164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:34.669430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:34.676447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:34.677887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 11:12:34.689309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:34.690322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Aug 17 11:12:34.691417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 643/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 17 11:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:34.696511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:34.756163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:34.814292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f89801-5be4-4ce3-b488-1b2fcc71686b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:34.850989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:34.851627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:34.851906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:34.852321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:34.853175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:34.853503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:34.855009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e93b-b718-4d63-b8be-395c49a12220 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:34.868840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 643/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 17 11:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:34.878854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:34.987735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617b01-de89-4f42-9c9d-7f4d2c201b03 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:35.025783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:35.026303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:35.026583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:35.026848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:35.027538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] RBAC: Adding query filter params (role.id=a17fbd5f1a91411583f4436858306f31, scope.project.id=0f2b0d96bb0c457e997d586501fbb618, user.id=e843df35ed704a3db7b73ee7678cb4e1) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:35.027842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:35.029342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46302afd-f4fc-4f02-9d7a-eaa21e48d896 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:35.035414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 644/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 17 11:12:34 2022] GET /identity/v3/role_assignments?user.id=e843df35ed704a3db7b73ee7678cb4e1&scope.project.id=0f2b0d96bb0c457e997d586501fbb618&role.id=a17fbd5f1a91411583f4436858306f31 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:36.984585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5461b-48a6-4b18-a180-b3868196f91b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:36.985467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5461b-48a6-4b18-a180-b3868196f91b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:36.985467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5461b-48a6-4b18-a180-b3868196f91b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:36.987622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 644/1288] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:36.996276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:36.996689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:36.996782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:37.020618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:37.021810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:37.054954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:37.094559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 645/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:37.382103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5461b-48a6-4b18-a180-b3868196f91b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:37.505434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5461b-48a6-4b18-a180-b3868196f91b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:37.516163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:37.545499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:37.546377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:37.546752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:37.547098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:37.547985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:37.550012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:37.559786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:37.561073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:37.562119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 645/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:12:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:37.567333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:37.667381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5995c-72bc-4217-a9ca-c7d2140d1a60 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:37.705531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:37.706129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:37.706401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:37.706664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:37.707285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:37.707631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:37.709582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393f47d-0e9c-41b8-9d65-7dc3eb321935 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:37.716165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 646/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 17 11:12:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:37.723938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:37.838054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f2b3-5c06-47b3-af3b-8fc7e5032ff3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:37.872732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:37.873345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:37.873619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:37.873889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:37.874517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:37.874819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:37.876210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb5dd-124c-450d-a874-32e0522be3c7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:37.880816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 646/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 17 11:12:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:39.745629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6632-65bb-456d-9b13-7e01bfde70c6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:39.746068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6632-65bb-456d-9b13-7e01bfde70c6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:39.746160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f6632-65bb-456d-9b13-7e01bfde70c6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:39.747504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 647/1293] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:39.753602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadc07-8e77-45f7-9b07-f8ff688f5972 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:39.754066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadc07-8e77-45f7-9b07-f8ff688f5972 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:39.754169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eadc07-8e77-45f7-9b07-f8ff688f5972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:39.779877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-90eadc07-8e77-45f7-9b07-f8ff688f5972 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:39.781117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-90eadc07-8e77-45f7-9b07-f8ff688f5972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:39.816843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:39.875515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 647/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:40.183836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6632-65bb-456d-9b13-7e01bfde70c6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:40.229631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:40.324870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f6632-65bb-456d-9b13-7e01bfde70c6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:40.371097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:40.371704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:40.372000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:40.372269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:40.372909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:40.374280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72b342-e2f0-4ecf-b2d7-95ad6c2aa4c8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:40.391436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 648/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 17 11:12:40 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:12:42.329872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346f9f-1ac0-4637-8e65-e0b202132792 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:42.330724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346f9f-1ac0-4637-8e65-e0b202132792 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:42.330724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b346f9f-1ac0-4637-8e65-e0b202132792 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:42.333059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 648/1296] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:42.340940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:42.341382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:42.341481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:42.361147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:42.362314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:42.469706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 649/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:42.734450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346f9f-1ac0-4637-8e65-e0b202132792 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:42.846771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b346f9f-1ac0-4637-8e65-e0b202132792 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:42.884155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:42.884773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:42.885049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:42.885318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:42.885895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:42.887281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:42.896150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:42.900105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:42.901170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 649/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:12:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:42.904903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:42.933520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:43.020801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca909b9-15a6-42c7-846d-57eaeb6e2035 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:43.058656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:43.059595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:43.060069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:43.060509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:43.061493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:43.061965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:43.064140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:43.072212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 650/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 17 11:12:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:43.078703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:43.123203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:43.205723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1992eb-7d00-482e-89b5-0404701caa65 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:43.244321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:43.244927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:43.245209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:43.245482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:43.246180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] RBAC: Adding query filter params (interface=public, service_id=6cdb85eaba744f5e98ab9c3533e64b23, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:43.246488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:43.247862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a00a7-60cc-4fdf-8c95-a20a47934ffc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:43.253111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 650/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 17 11:12:43 2022] GET /identity/v3/endpoints?service_id=6cdb85eaba744f5e98ab9c3533e64b23&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:12:43.259348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:43.347153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:43.366181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c669180-3662-49dd-9303-be4a3855b524 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:43.404766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:43.405365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:43.405640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:43.405906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:43.406496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:43.407865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0804cf0-7739-40aa-b7cc-ad6f1c89add6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:43.414949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 651/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 17 11:12:43 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:12:45.324719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ec6-85f2-4757-8625-c13ddc98f42a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:45.325652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ec6-85f2-4757-8625-c13ddc98f42a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:45.325652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65100ec6-85f2-4757-8625-c13ddc98f42a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:45.327729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 651/1302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:12:45.334071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:45.334779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:45.334927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:45.360340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:12:45.361513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:12:45.430518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 652/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:12:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 11:12:45.700357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65100ec6-85f2-4757-8625-c13ddc98f42a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:45.806310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:45.813768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65100ec6-85f2-4757-8625-c13ddc98f42a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:45.849402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:45.850031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:45.850298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:45.850559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:45.851170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:45.852663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 11:12:45.861605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 11:12:45.862749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Aug 17 11:12:45.863601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 652/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 17 11:12:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 11:12:45.869239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:45.950262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:45.984999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82049d42-f8c4-4769-a35d-136b2fee33aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:46.023271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:46.024173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:46.024173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:46.024402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:46.025046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:12:46.025346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:46.026724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875d294-7a4f-49f3-b217-496f49c391b9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:46.032385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 653/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 17 11:12:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:12:46.039707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:12:46.153874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1cee-4fef-42d6-97bd-4acfa66b0f9e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:12:46.197891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:12:46.198704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:12:46.199102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:12:46.199378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:12:46.200071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:12:46.201423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf92385-ee4a-4830-98e4-4e64f9b4e253 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:12:46.232471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 653/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:12:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:12:56.029330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=30 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:12:56.227418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:50.320061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9545-0487-46ac-91ed-b08cf62dbc78 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:50.320637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9545-0487-46ac-91ed-b08cf62dbc78 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:50.320637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b9545-0487-46ac-91ed-b08cf62dbc78 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:50.328055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 654/1307] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:13:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:13:50.329642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64eef-c83d-450d-985d-5e57b602e448 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:50.330125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64eef-c83d-450d-985d-5e57b602e448 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:50.330815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64eef-c83d-450d-985d-5e57b602e448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:50.430267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a1b64eef-c83d-450d-985d-5e57b602e448 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:13:50.432152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a1b64eef-c83d-450d-985d-5e57b602e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:50.598055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 654/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:13:50.872313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:50.872877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:50.873258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:50.874700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 655/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 17 11:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:13:50.880943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6f14-9ede-4853-85b0-8b709639fdaa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:50.881348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6f14-9ede-4853-85b0-8b709639fdaa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:50.881725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d6f14-9ede-4853-85b0-8b709639fdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:50.969315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4d7d6f14-9ede-4853-85b0-8b709639fdaa None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:13:50.970738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4d7d6f14-9ede-4853-85b0-8b709639fdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:50.996558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:51.060006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 655/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 17 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:13:51.069094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:13:51.070857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:51.189327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2df94-c3ae-4411-aa70-c64d11f28011 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:13:51.266428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:13:51.267217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:51.267602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:51.268037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:51.269768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:51.332796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:51.396398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:13:51.398605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e9bd8-ba15-4c59-96de-8ed214e2df01 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:13:51.419814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 656/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:13:53.590672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:53.591203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:53.591297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:53.592803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 656/1312] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:13:53.598350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c42d-7e53-401a-ab73-ca082f07cd2d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:53.598892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c42d-7e53-401a-ab73-ca082f07cd2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:53.598892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c42d-7e53-401a-ab73-ca082f07cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:53.674959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a52c42d-7e53-401a-ab73-ca082f07cd2d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:13:53.676201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a52c42d-7e53-401a-ab73-ca082f07cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:53.779139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 657/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:13:54.070021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:13:54.072633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:54.189657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150245-407c-4820-a16c-e73dab7464a8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:13:54.264604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:54.267797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:13:54.268732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:54.269125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:54.269478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:54.272204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:54.388306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:13:54.389778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918269-38d8-4958-ba0b-28a42abb656c service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:13:54.412162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 657/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:13:56.630166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:56.630994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:56.630994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:56.633040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 658/1315] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:13:56.639215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0bef4-37dc-4671-9fae-7dadf4dc0c9c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:56.639953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0bef4-37dc-4671-9fae-7dadf4dc0c9c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:56.640081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0bef4-37dc-4671-9fae-7dadf4dc0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:56.716232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-97d0bef4-37dc-4671-9fae-7dadf4dc0c9c None None] MFA Rules not processed for user `d193d288f745403fa4e799d290b507cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:13:56.717436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-97d0bef4-37dc-4671-9fae-7dadf4dc0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:56.772425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:56.817808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 658/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:13:57.098333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:13:57.099910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:57.110782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:57.213113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130acddd-9848-4c79-b3d7-47601a735d65 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:13:57.290132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:13:57.290735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:57.291013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:57.291256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:57.292904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:13:57.358472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:13:57.413353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:13:57.414789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e162-a517-446f-b6b5-f0dad4e3d786 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:13:57.434873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 659/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:13:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:13:59.886881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:59.887777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:59.887777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:59.889913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 659/1318] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:13:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:13:59.895454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12aaa-af42-4cca-984c-d8bc325f9eb6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:13:59.895884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12aaa-af42-4cca-984c-d8bc325f9eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:13:59.896030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12aaa-af42-4cca-984c-d8bc325f9eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:13:59.985784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cba12aaa-af42-4cca-984c-d8bc325f9eb6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:13:59.987180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cba12aaa-af42-4cca-984c-d8bc325f9eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:00.086502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 660/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:13:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:00.387807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:00.390277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:00.501810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ee21-fc6e-48d2-b0fc-3d701169fd5e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:00.598143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:00.598758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:00.599030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:00.599303 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:00.601068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:00.608997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:00.717351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:00.718819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adbc6a-ccc3-4de1-aad0-28337734b8e5 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:00.737973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 660/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:03.307769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:03.308348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:03.308348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:03.309588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 661/1321] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:03.315007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c387b6-ddc3-487a-9e8c-a42d9fb1c5db None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:03.315456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c387b6-ddc3-487a-9e8c-a42d9fb1c5db None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:03.315596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c387b6-ddc3-487a-9e8c-a42d9fb1c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:03.383124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f0c387b6-ddc3-487a-9e8c-a42d9fb1c5db None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:03.384360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f0c387b6-ddc3-487a-9e8c-a42d9fb1c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:03.446929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:03.488736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 661/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:03.767465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:03.769100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:03.791278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:03.883579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe938d8-62a5-4380-b762-392a6927e9a1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:03.959012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:03.959486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:03.959785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:03.960090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:03.961692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:04.034821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:04.075079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:04.076841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef9b28-7640-4f1c-8492-a0b4b9276c8b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:04.096089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 662/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:06.098375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26cad8-7d42-466f-aad9-832663513fe8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:06.098952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26cad8-7d42-466f-aad9-832663513fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:06.098952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26cad8-7d42-466f-aad9-832663513fe8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:06.100199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 662/1324] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:06.105599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930318-9a30-4f94-8457-fd79c5639ee6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:06.106057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930318-9a30-4f94-8457-fd79c5639ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:06.106168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930318-9a30-4f94-8457-fd79c5639ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:06.178804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-75930318-9a30-4f94-8457-fd79c5639ee6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:06.180058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75930318-9a30-4f94-8457-fd79c5639ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:06.279745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 663/1325] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:06.579015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:06.579343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:06.579612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:06.581134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 663/1326] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 17 11:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:06.587682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eda12-020f-49bf-b4d8-d1aaebe49085 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:06.587965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eda12-020f-49bf-b4d8-d1aaebe49085 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:06.588276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eda12-020f-49bf-b4d8-d1aaebe49085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:06.620877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:06.666480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc1eda12-020f-49bf-b4d8-d1aaebe49085 None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:06.667642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc1eda12-020f-49bf-b4d8-d1aaebe49085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:06.746180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 664/1327] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 17 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:06.755701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:06.757384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:06.864813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f1e16-b362-4a7f-89d1-3c09a36bb67b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:06.947113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:06.947735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:06.948175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:06.948445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:06.950059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:06.967954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:07.066271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:07.067711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2713e8-a8a7-49fa-8442-df829716f9a0 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:07.086750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 664/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:09.256762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:09.257305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:09.257305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:09.258584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 665/1329] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:09.264193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665864-d1b8-4797-bb57-d036d64a5407 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:09.264700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665864-d1b8-4797-bb57-d036d64a5407 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:09.264700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665864-d1b8-4797-bb57-d036d64a5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:09.335216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e3665864-d1b8-4797-bb57-d036d64a5407 None None] MFA Rules not processed for user `d193d288f745403fa4e799d290b507cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:09.336419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e3665864-d1b8-4797-bb57-d036d64a5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:09.401794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:09.444411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 665/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:14:09.741873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:09.743460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:09.895882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9fcac-2f3c-48c0-9f1e-4eb098edf19c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:09.922289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:09.983737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:09.985077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:09.985397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:09.985685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:09.987328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:10.133506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:10.135332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36faab0a-109f-4309-9168-d7dccae92349 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:10.157926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 666/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:12.476803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:12.477574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:12.477574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:12.479635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 666/1332] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:12.485022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07df3-d98d-44d0-a67a-9ba1f03b6520 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:12.485492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07df3-d98d-44d0-a67a-9ba1f03b6520 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:12.485585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07df3-d98d-44d0-a67a-9ba1f03b6520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:12.558173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:12.562575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4ef07df3-d98d-44d0-a67a-9ba1f03b6520 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:12.564519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ef07df3-d98d-44d0-a67a-9ba1f03b6520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:12.684415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 667/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:12.962576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:12.964211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:13.080517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0bd0-d841-4659-9bd6-a506c2fce387 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:13.167887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:13.168849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:13.169244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:13.169646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:13.172196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:13.205421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:13.300329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:13.301783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1c3b-0957-4b12-af0f-0a4ed7ee53db service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:13.321482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 667/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:15.243145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:15.244023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:15.244150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:15.246257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 668/1335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:15.251645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4f5f-16fe-4b69-9658-cfc486951ac7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:15.252117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4f5f-16fe-4b69-9658-cfc486951ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:15.252212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4f5f-16fe-4b69-9658-cfc486951ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:15.327606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6ead4f5f-16fe-4b69-9658-cfc486951ac7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:15.328854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6ead4f5f-16fe-4b69-9658-cfc486951ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:15.419783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:15.443902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 668/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:15.742968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:15.744588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:15.867622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980506d-c42e-4ffb-9450-8227964fab9a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:15.897368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:15.944546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:15.945150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:15.945418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:15.945681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:15.947261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:16.080235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:16.081603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4c622-9bef-493f-aba7-714bb705843e service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:16.103122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 669/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:18.363752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:18.364723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:18.364723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:18.366870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 669/1338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:18.375516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0111-3c0e-402f-8628-7736b4cab403 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:18.375983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0111-3c0e-402f-8628-7736b4cab403 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:18.376096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c0111-3c0e-402f-8628-7736b4cab403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:18.444081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8e4c0111-3c0e-402f-8628-7736b4cab403 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:18.445294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8e4c0111-3c0e-402f-8628-7736b4cab403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:18.459657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:18.555733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 670/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:18.837339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:18.839797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:18.957153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588a3f-4f6c-4662-905d-0d35384d0463 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:19.030901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:19.031515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:19.031974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:19.032333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:19.034004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:19.069440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:19.145425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:19.146848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e39a-0a76-4f5a-b4ca-ac8e6c58ea65 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:19.168989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 670/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:23.077623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:23.078231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:23.078231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:23.079545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 671/1341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:23.084719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f4e-f536-40d2-a936-755d6bf67d37 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:23.085171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f4e-f536-40d2-a936-755d6bf67d37 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:23.085267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d938f4e-f536-40d2-a936-755d6bf67d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:23.152726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1d938f4e-f536-40d2-a936-755d6bf67d37 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:23.154242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d938f4e-f536-40d2-a936-755d6bf67d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:23.244655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:23.257862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 671/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:23.535658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:23.537296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:23.644065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d0608-90ef-4af4-ab8c-79e0dcd8f006 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:23.682918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:23.720293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:23.720901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:23.721176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:23.721413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:23.723034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:23.840879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:23.842376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c62ef-1506-488a-af00-6338a780adf6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:23.862484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 672/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:26.545879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:26.546611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:26.546611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:26.547812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 672/1344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:26.553330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d246-c617-4829-a0f6-cfccc1f3d1fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:26.553745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d246-c617-4829-a0f6-cfccc1f3d1fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:26.553937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414d246-c617-4829-a0f6-cfccc1f3d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:26.624386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6414d246-c617-4829-a0f6-cfccc1f3d1fb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:26.625562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6414d246-c617-4829-a0f6-cfccc1f3d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:26.645024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:26.726044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 673/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:27.004738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:27.006346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:27.117778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31caac0d-416d-4379-b3c6-1b0711b1ccb2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:27.206090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:27.207062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:27.207414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:27.207796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:27.210484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:27.261358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:27.329702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:27.331170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01b394-4119-4fdf-af46-e97acf6638c4 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:27.351738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 673/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:31.418457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f42a-d639-4031-8292-ac874d805756 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:31.418985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f42a-d639-4031-8292-ac874d805756 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:31.418985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198f42a-d639-4031-8292-ac874d805756 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:31.420455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 674/1347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:31.426215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f04f-27ac-4509-bd3a-8ed4996bf9ca None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:31.426746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f04f-27ac-4509-bd3a-8ed4996bf9ca None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:31.426746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f04f-27ac-4509-bd3a-8ed4996bf9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:31.499433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4fe5f04f-27ac-4509-bd3a-8ed4996bf9ca None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:31.501253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4fe5f04f-27ac-4509-bd3a-8ed4996bf9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:31.601474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:31.604162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 674/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:31.888264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198f42a-d639-4031-8292-ac874d805756 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:31.890307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b198f42a-d639-4031-8292-ac874d805756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:32.004716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198f42a-d639-4031-8292-ac874d805756 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:32.053848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:32.079906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:32.080534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:32.080804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:32.081073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:32.082662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:32.199770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:32.201248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e0cb4-4126-4b9c-aef1-a4e1c93ee71c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:32.222876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 675/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:37.155466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137c8d5-bc23-4825-b396-bcb3d9031d43 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:37.156799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137c8d5-bc23-4825-b396-bcb3d9031d43 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:37.157292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137c8d5-bc23-4825-b396-bcb3d9031d43 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:37.158932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 675/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:37.164276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d325-464d-4d16-8514-85978ab001f1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:37.165101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d325-464d-4d16-8514-85978ab001f1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:37.165612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823d325-464d-4d16-8514-85978ab001f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:37.294071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7823d325-464d-4d16-8514-85978ab001f1 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:37.295270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7823d325-464d-4d16-8514-85978ab001f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:37.314599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:37.429881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 676/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:14:41.531298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8ba8-1097-4141-9415-7f4c23afd749 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:41.531989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8ba8-1097-4141-9415-7f4c23afd749 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:41.531989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8ba8-1097-4141-9415-7f4c23afd749 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:41.533451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 676/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:41.538396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17ba3-6ef6-4be6-9117-ab8cc8706a47 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:41.538888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17ba3-6ef6-4be6-9117-ab8cc8706a47 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:41.538995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf17ba3-6ef6-4be6-9117-ab8cc8706a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:41.624841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9cf17ba3-6ef6-4be6-9117-ab8cc8706a47 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:41.626046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9cf17ba3-6ef6-4be6-9117-ab8cc8706a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:41.699542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:41.743749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 677/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:14:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:43.213519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6232c-a72b-4a52-b888-ffb155073277 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:43.214090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6232c-a72b-4a52-b888-ffb155073277 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:43.214090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6232c-a72b-4a52-b888-ffb155073277 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:43.215545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 677/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:43.221019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10400-a807-4bf6-9983-093395c254fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:43.221506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10400-a807-4bf6-9983-093395c254fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:43.221856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c10400-a807-4bf6-9983-093395c254fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:43.304110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7c10400-a807-4bf6-9983-093395c254fb None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:43.305307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7c10400-a807-4bf6-9983-093395c254fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:43.414668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 678/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:14:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:14:47.208672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05367-267f-42dd-a01d-1a546adde6ed None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:47.209257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05367-267f-42dd-a01d-1a546adde6ed None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:47.209257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a05367-267f-42dd-a01d-1a546adde6ed None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:47.210568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 678/1356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:47.215806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e61d-af9c-416d-ba5a-96b8449fbc8b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:47.216785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e61d-af9c-416d-ba5a-96b8449fbc8b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:47.217229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585e61d-af9c-416d-ba5a-96b8449fbc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:47.270717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:47.326633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c585e61d-af9c-416d-ba5a-96b8449fbc8b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:47.327848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c585e61d-af9c-416d-ba5a-96b8449fbc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:47.477830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 679/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:47.772751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:47.773032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:47.773700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:47.775066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 679/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 17 11:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:47.782654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1180d4-837a-4ab3-ab0a-06b2d68de0c0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:47.783241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1180d4-837a-4ab3-ab0a-06b2d68de0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:47.783762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1180d4-837a-4ab3-ab0a-06b2d68de0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:47.872826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ba1180d4-837a-4ab3-ab0a-06b2d68de0c0 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:47.874405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ba1180d4-837a-4ab3-ab0a-06b2d68de0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:47.923197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:48.005799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 680/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 17 11:14:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:48.014142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:48.015786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:48.178186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeab64b-dcd6-4b09-90b4-752561810c9a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:48.266400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:48.313005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:48.313620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:48.313888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:48.314156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:48.317085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:48.410913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:48.412535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b930-39fb-4e65-b761-6846fe2c148e service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:48.430935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 680/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:50.588139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:50.588856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:50.588856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:50.590432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 681/1361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:50.597105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b909-9c4d-4927-bcdb-b372e7601df0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:50.597671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b909-9c4d-4927-bcdb-b372e7601df0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:50.598131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b909-9c4d-4927-bcdb-b372e7601df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:50.691655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c140b909-9c4d-4927-bcdb-b372e7601df0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:50.692987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c140b909-9c4d-4927-bcdb-b372e7601df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:50.741864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:50.812013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 681/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:51.096731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:51.098201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:51.260235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0d87b-e406-4fff-8747-75e3a1bb279b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:51.271570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:51.386288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:51.386901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:51.387244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:51.387525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:51.389338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:51.489406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:51.491153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae3673-b013-40e1-8c0b-e80d3e477bf0 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:51.510389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 682/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:53.793281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b208-40c3-483b-8576-75ba9034ae9f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:53.793843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b208-40c3-483b-8576-75ba9034ae9f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:53.794043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077b208-40c3-483b-8576-75ba9034ae9f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:53.796374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 682/1364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:53.802026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c8f-3f15-448e-b9ed-83b6474a513f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:53.802450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c8f-3f15-448e-b9ed-83b6474a513f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:53.802623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c8f-3f15-448e-b9ed-83b6474a513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:53.826916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:53.899867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e1675c8f-3f15-448e-b9ed-83b6474a513f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:53.901104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e1675c8f-3f15-448e-b9ed-83b6474a513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:54.015961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 683/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:54.304222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:54.304775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:54.305067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:54.306596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 683/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 17 11:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:54.312172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb899e7-f14c-4037-8bfd-8b36caab4654 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:54.312566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb899e7-f14c-4037-8bfd-8b36caab4654 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:54.312940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb899e7-f14c-4037-8bfd-8b36caab4654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:54.396828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-beb899e7-f14c-4037-8bfd-8b36caab4654 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:54.398220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-beb899e7-f14c-4037-8bfd-8b36caab4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:54.436675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:54.529242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 684/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 17 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:54.537604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:54.539233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:54.696999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa337-c6e1-4b0e-ad10-75bf888cb043 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:54.718426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:54.832458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:54.833186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:54.833441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:54.833569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:54.835187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:54.935082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:54.937354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0451112-b63d-4012-86a8-0bfe46c8873d service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:54.958508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 684/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:55.483013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c637d-7f8d-4943-93c2-c96082d93d6d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:55.483553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c637d-7f8d-4943-93c2-c96082d93d6d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:55.483553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c637d-7f8d-4943-93c2-c96082d93d6d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:55.485139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 685/1369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:55.490385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc938a9-3ab6-4284-b167-25b92909ff01 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:55.490643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc938a9-3ab6-4284-b167-25b92909ff01 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:55.490936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc938a9-3ab6-4284-b167-25b92909ff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:55.523378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:55.560776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fbc938a9-3ab6-4284-b167-25b92909ff01 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:55.562088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fbc938a9-3ab6-4284-b167-25b92909ff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:55.665066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 685/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:56.214172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:56.214753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:56.215236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:56.217108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 686/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 17 11:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:14:56.222406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36f7e-f8eb-4f9c-9e30-0a5175d72d46 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:56.223254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36f7e-f8eb-4f9c-9e30-0a5175d72d46 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:56.223722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36f7e-f8eb-4f9c-9e30-0a5175d72d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:56.302623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-37c36f7e-f8eb-4f9c-9e30-0a5175d72d46 None None] MFA Rules not processed for user `4d42cfa2d2e9453d879c623cae849ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:56.304307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-37c36f7e-f8eb-4f9c-9e30-0a5175d72d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:56.354144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:56.391596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 17 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:56.399664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:56.401316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:56.509149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579db9c-5e4b-4aab-8348-4e7fa61b5965 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:56.550453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:56.585883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:56.586495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:56.586774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:56.587046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:56.588684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:56.731901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:56.734830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3747fce-0ac2-4955-a845-853127f64e2c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:56.757760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 687/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:56.961416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:56.961718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:56.962222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:56.964555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 687/1374] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:56.969738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbc46-15bc-4d48-8d24-c0e4b29647f1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:56.970065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbc46-15bc-4d48-8d24-c0e4b29647f1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:56.970558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbc46-15bc-4d48-8d24-c0e4b29647f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:57.053147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2e9bbc46-15bc-4d48-8d24-c0e4b29647f1 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:57.053714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e9bbc46-15bc-4d48-8d24-c0e4b29647f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:57.085050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:57.171939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 688/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:14:57.464011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:14:57.465536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:57.614527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1a054-7dc7-4b52-9ced-c2cd1fc3e18e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:14:57.669215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:57.736451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:14:57.737295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:57.737778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:57.738267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:57.740784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:57.834000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:14:57.835608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ed209-de6d-4470-bc93-a7aaafa5c237 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:14:57.854600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 688/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:14:59.770767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:59.771175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:59.771307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:59.772677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 689/1377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:14:59.778300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ee56-fac0-4abc-9f39-1317e36e78f9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:14:59.778823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ee56-fac0-4abc-9f39-1317e36e78f9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:14:59.779407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3ee56-fac0-4abc-9f39-1317e36e78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:14:59.859763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-32c3ee56-fac0-4abc-9f39-1317e36e78f9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:14:59.860956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-32c3ee56-fac0-4abc-9f39-1317e36e78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:14:59.867605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:14:59.957462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 689/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:00.256731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:00.258243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:00.431816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5136a-f7a6-4bee-aa57-e3cefab02864 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:00.435955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:00.560118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:00.560944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:00.561308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:00.562678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:00.563581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:00.658308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:00.660087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059ba5-5f5d-4797-90a3-ad26fb09a657 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:00.679198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 690/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:02.608227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:02.608690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:02.608690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:02.610182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 690/1380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:02.615390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c64c-e0a2-472a-96b0-f5418262f902 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:02.615828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c64c-e0a2-472a-96b0-f5418262f902 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:02.615989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0c64c-e0a2-472a-96b0-f5418262f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:02.627518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:02.687270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2bb0c64c-e0a2-472a-96b0-f5418262f902 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:02.688501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2bb0c64c-e0a2-472a-96b0-f5418262f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:02.799392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 691/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:15:03.086601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:03.088289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:03.257832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:03.269304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91d94-1cc2-4f02-8bc3-6774db0cf5ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:03.388092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:03.388709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:03.388983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:03.389248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:03.390848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:03.495103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:03.496979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0bc41-92fd-4d31-aa17-f7e350582311 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:03.508001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:03.518019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 691/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:05.493788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:05.494382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:05.494382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:05.495769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 692/1383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:05.501350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0038-62ac-44f1-bdeb-c45c57dd7a8d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:05.501872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0038-62ac-44f1-bdeb-c45c57dd7a8d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:05.502045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0038-62ac-44f1-bdeb-c45c57dd7a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:05.573619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8b3e0038-62ac-44f1-bdeb-c45c57dd7a8d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:05.575525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b3e0038-62ac-44f1-bdeb-c45c57dd7a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:05.684358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 692/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:15:05.993008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:05.995087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:06.122401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:06.191582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f035bb9-d32d-448f-865c-7466de51a018 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:06.324420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:06.325472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:06.325711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:06.325973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:06.327650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:06.398148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:06.449755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:06.451469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55c441-b019-4acf-b82c-90b0afc92692 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:06.470544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 693/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:08.675628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:08.676319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:08.676437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:08.678180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 693/1386] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:08.684826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a15-9419-4d90-9ceb-7251e377a6de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:08.685292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a15-9419-4d90-9ceb-7251e377a6de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:08.685606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a15-9419-4d90-9ceb-7251e377a6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:08.760860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e5d86a15-9419-4d90-9ceb-7251e377a6de None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:08.762193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5d86a15-9419-4d90-9ceb-7251e377a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:08.887222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 694/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:09.172492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:09.174004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:09.257333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:09.329582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd17b8-df12-4a8e-9c5e-cd33c54cf197 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:09.452404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:09.452992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:09.453233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:09.453503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:09.455133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:09.494892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:09.549097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:09.550696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb1e63-78f0-44e7-b811-04ef6eb1c880 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:09.569352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 694/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:11.503811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ceb26-535a-49b9-b1b3-de064e5150ae None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:11.504457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ceb26-535a-49b9-b1b3-de064e5150ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:11.504457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ceb26-535a-49b9-b1b3-de064e5150ae None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:11.505747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 695/1389] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:11.511092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1250-c93c-405d-b194-5954fac34868 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:11.511572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1250-c93c-405d-b194-5954fac34868 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:11.511725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1250-c93c-405d-b194-5954fac34868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:11.578699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-839e1250-c93c-405d-b194-5954fac34868 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:11.579937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-839e1250-c93c-405d-b194-5954fac34868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:11.676156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:11.676404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:11.676688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:11.677492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 695/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:11.678151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 696/1391] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:15:11.683088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9de-e7ed-431a-9fc8-2d38222b3fab None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:11.683373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9de-e7ed-431a-9fc8-2d38222b3fab None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:11.683700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d9de-e7ed-431a-9fc8-2d38222b3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:11.698615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:11.752235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5df5d9de-e7ed-431a-9fc8-2d38222b3fab None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:11.753459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5df5d9de-e7ed-431a-9fc8-2d38222b3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:11.852428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 696/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:11.959905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:11.961508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:11.994672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:12.112859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed1f69-bb17-4194-a220-22259f614d59 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:12.148244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7a6d-bc09-46dd-b2f5-4133bec7d2f1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:12.148615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7a6d-bc09-46dd-b2f5-4133bec7d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:12.148888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a7a6d-bc09-46dd-b2f5-4133bec7d2f1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:12.150326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 697/1393] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 17 11:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:12.156550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:12.156831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:12.157091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:12.220646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:12.232327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:12.232936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:12.233218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:12.233485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:12.235112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:12.236607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] MFA Rules not processed for user `ded8007ff9d64b5b809eef243b8d7895`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:12.237798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:12.273456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:12.320920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 698/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 17 11:15:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:12.329759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:12.337476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4563f-613b-41c6-b8f2-da1b87a94c5b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:12.340161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:12.342120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823842d7-7210-4b6e-b53e-b246fd772246 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:12.360656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 697/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:12.415453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:12.416188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:12.416486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:12.416755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:12.418643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:12.537655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:12.542835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:12.544574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06ad7-37e5-43c2-84c9-39ff9fa59261 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:12.566857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 699/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:15:13.336303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745fb5-c070-425e-bbec-af2c63947dc9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:13.336801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745fb5-c070-425e-bbec-af2c63947dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:13.336913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745fb5-c070-425e-bbec-af2c63947dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:13.406590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e9745fb5-c070-425e-bbec-af2c63947dc9 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:13.407824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e9745fb5-c070-425e-bbec-af2c63947dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:13.468957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:13.501206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 698/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:13.548205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:13.549166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:13.549444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:13.550795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 700/1398] 10.222.0.18 () {54 vars in 943 bytes} [Wed Aug 17 11:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:13.557772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966497-2ecb-4f46-94c6-50e29ea9f54f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:13.558136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966497-2ecb-4f46-94c6-50e29ea9f54f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:13.558503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0966497-2ecb-4f46-94c6-50e29ea9f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:13.637037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f0966497-2ecb-4f46-94c6-50e29ea9f54f None None] MFA Rules not processed for user `89e54d17894648ff81de2b23119732fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:13.638224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0966497-2ecb-4f46-94c6-50e29ea9f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:13.751962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 699/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Aug 17 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:13.761402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:13.762990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:13.906084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18499505-9f61-4ba7-959f-b9876aa66524 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:13.977671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:14.011945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:14.012647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:14.012920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:14.013184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:14.014823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:14.109440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:14.111066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f46b-a772-4640-bbad-74af64704217 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:14.119171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 701/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:15:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:15:14.342060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:14.342603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:14.342603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:14.344090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 700/1401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:14.349188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998487-3309-480c-b704-23b8bc5ede41 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:14.349480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998487-3309-480c-b704-23b8bc5ede41 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:14.349758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998487-3309-480c-b704-23b8bc5ede41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:14.421448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fa998487-3309-480c-b704-23b8bc5ede41 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:14.422594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fa998487-3309-480c-b704-23b8bc5ede41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:14.482196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:14.539940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 702/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:14.847005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:14.849531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:14.894860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:15.018414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07450-7b97-4976-bd35-b1359091b746 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:15.145449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:15.148398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:15.149220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:15.149705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:15.150318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:15.153687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:15.258226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:15.259904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b354ed-0ee3-4f88-a264-915da1683c31 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:15.281286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 701/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:17.261870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:17.262473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:17.262473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:17.263805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 703/1404] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:17.269337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c538-55cb-4abd-b5f6-5974956f41b9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:17.270136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c538-55cb-4abd-b5f6-5974956f41b9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:17.270398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c538-55cb-4abd-b5f6-5974956f41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:17.350081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b432c538-55cb-4abd-b5f6-5974956f41b9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:17.351445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b432c538-55cb-4abd-b5f6-5974956f41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:17.425595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:17.459677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 702/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:17.758186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:17.759795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:17.920344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f34296-1da0-4850-aa73-85a7eb2e6ad6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:17.968431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:18.054057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:18.054584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:18.054856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:18.055119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:18.056755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:18.163314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:18.165008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b35a65-78fc-4ebb-9cbf-7d4cd1f3dc0b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:18.187021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 704/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:20.129886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:20.130417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:20.130417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:20.132124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 703/1407] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:20.137819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2da529-8552-4160-b1f9-da5dfbc8bba9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:20.138320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2da529-8552-4160-b1f9-da5dfbc8bba9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:20.138404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2da529-8552-4160-b1f9-da5dfbc8bba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:20.201940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:20.210368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ae2da529-8552-4160-b1f9-da5dfbc8bba9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:20.211625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ae2da529-8552-4160-b1f9-da5dfbc8bba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:20.318375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 705/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:20.610180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:20.611716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:20.786817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566672-bd89-41b1-a756-a4672cc71f54 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:20.845914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:20.913257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:20.913874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:20.914144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:20.914405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:20.916038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:21.013066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:21.014932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2b76-f26c-4345-801b-fda8581c6b46 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:21.034335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 704/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:30.316147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=44 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:31.032082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=73 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:35.947797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd83ce-9431-4863-bf2c-e8560ad1eb09 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:35.948424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd83ce-9431-4863-bf2c-e8560ad1eb09 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:35.948424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd83ce-9431-4863-bf2c-e8560ad1eb09 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:35.949766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 706/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 17 11:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:35.954991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d823b-65e8-495d-bd82-022ccc25b594 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:35.955436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d823b-65e8-495d-bd82-022ccc25b594 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:35.955546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d823b-65e8-495d-bd82-022ccc25b594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:36.041844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-318d823b-65e8-495d-bd82-022ccc25b594 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:36.042982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-318d823b-65e8-495d-bd82-022ccc25b594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:36.164765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 705/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 17 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:36.180434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3c27-2eec-4137-b9f0-16146ca15dab None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:36.180715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3c27-2eec-4137-b9f0-16146ca15dab None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:36.180980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3c27-2eec-4137-b9f0-16146ca15dab None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:36.182639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 707/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 17 11:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:36.187501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b3ba-7eb4-4cf2-ba8e-4351043c9607 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:36.187781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b3ba-7eb4-4cf2-ba8e-4351043c9607 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:36.188073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b3ba-7eb4-4cf2-ba8e-4351043c9607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:36.264946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:36.267932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af61b3ba-7eb4-4cf2-ba8e-4351043c9607 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:36.269440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af61b3ba-7eb4-4cf2-ba8e-4351043c9607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:36.408814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 706/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 17 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:38.798837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:38.799382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:38.799382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:38.800786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:38.805996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380995a4-1b3a-407a-a326-be67903c792e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:38.806535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380995a4-1b3a-407a-a326-be67903c792e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:38.806721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380995a4-1b3a-407a-a326-be67903c792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:38.875425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-380995a4-1b3a-407a-a326-be67903c792e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:38.876655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-380995a4-1b3a-407a-a326-be67903c792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:38.935967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:38.982512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:39.270301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:39.272936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:39.430964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35430a3-2439-4f63-ae9c-7b1ae7f6baef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:39.509135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:39.551285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:39.551905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:39.552214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:39.552491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:39.554140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:39.651756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:39.653409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b0b3b-bcab-4b6c-9219-802f0885e993 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:39.676580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 709/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:40.607838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:40.608477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:40.608477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:40.611695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:40.617051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50a2-32a9-4d71-9e3c-5d49cc74b795 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:40.617507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50a2-32a9-4d71-9e3c-5d49cc74b795 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:40.617606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d50a2-32a9-4d71-9e3c-5d49cc74b795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:40.740737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-553d50a2-32a9-4d71-9e3c-5d49cc74b795 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:40.741973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-553d50a2-32a9-4d71-9e3c-5d49cc74b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:40.777069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:40.859206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:41.008876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:41.011000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:41.178154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6c957-3225-4dae-a7db-fdc43b786a01 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:41.219929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:41.296711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:41.297314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:41.297590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:41.297860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:41.299482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:41.397997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:41.400014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76032a7f-594e-48ce-9e99-30ddd0320f45 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:41.419800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 709/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:42.305192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:42.306294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:42.306294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:42.307848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:42.315810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9608-df12-4e81-bdac-e249fcdcdf51 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:42.316543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9608-df12-4e81-bdac-e249fcdcdf51 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:42.316689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f9608-df12-4e81-bdac-e249fcdcdf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:42.380892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:42.405456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-790f9608-df12-4e81-bdac-e249fcdcdf51 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:42.406714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-790f9608-df12-4e81-bdac-e249fcdcdf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:42.509783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:42.661865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:42.663758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:42.828708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b895467-3977-4d82-ac01-002a58c000ec None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:42.841242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:42.947284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:42.947775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:42.948077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:42.948342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:42.949942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:43.046014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:43.047612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9bb8-613e-4f11-9fd0-fa46571f7bf7 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:43.065727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 712/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:43.920463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:43.921055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:43.921055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:43.922355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:43.928625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a215-cd4b-4ad4-9072-83bb97429b33 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:43.929398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a215-cd4b-4ad4-9072-83bb97429b33 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:43.929535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a215-cd4b-4ad4-9072-83bb97429b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:43.952180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:44.017846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c31a215-cd4b-4ad4-9072-83bb97429b33 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:44.019493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c31a215-cd4b-4ad4-9072-83bb97429b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:44.123261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:44.285323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:44.287462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:44.539887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:44.579945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff13c3-a452-4024-b03f-e115c94f79ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:44.699949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:44.700548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:44.700826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:44.701081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:44.702726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:44.782340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:44.797967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:44.799514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6927f-656f-4b06-ba54-27699f7b55cc service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:44.818290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 712/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:45.690633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:45.691202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:45.691202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:45.692550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:45.698537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccbf1-46e6-4883-af5d-d76c91ce0b9e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:45.699003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccbf1-46e6-4883-af5d-d76c91ce0b9e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:45.699108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fccbf1-46e6-4883-af5d-d76c91ce0b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:45.785484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f0fccbf1-46e6-4883-af5d-d76c91ce0b9e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:45.786688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0fccbf1-46e6-4883-af5d-d76c91ce0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:45.885891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:46.033828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:46.035342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:46.125958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:46.190742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c2591-0fba-421c-a22b-2dcd4b051b67 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:46.319764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:46.320403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:46.320682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:46.320950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:46.322647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:46.370886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:46.414545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:46.416366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d082495-0342-4fe4-b644-e5e711d7fef3 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:46.434769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 715/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:47.269981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:47.270841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:47.270841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:47.273026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:47.281914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4430-f3f6-49c4-acf1-ca91f7a9c710 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:47.282684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4430-f3f6-49c4-acf1-ca91f7a9c710 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:47.282858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4430-f3f6-49c4-acf1-ca91f7a9c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:47.367837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ae9b4430-f3f6-49c4-acf1-ca91f7a9c710 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:47.369287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ae9b4430-f3f6-49c4-acf1-ca91f7a9c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:47.473904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:47.628516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:47.630853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:47.690319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:47.796563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a243f-f178-431e-b75a-9f9832ed21be None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:47.919428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:47.920073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:47.920347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:47.920613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:47.922235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:47.929603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:48.016617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:48.018126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a2a30-1439-4572-8918-d7db24cab6f2 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:48.037454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 715/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:48.873313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:48.873900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:48.873900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:48.875214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:48.881294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22128-e607-4933-8a4b-40ab42a1bde7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:48.882082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22128-e607-4933-8a4b-40ab42a1bde7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:48.882252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22128-e607-4933-8a4b-40ab42a1bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:48.966655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fef22128-e607-4933-8a4b-40ab42a1bde7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:48.967877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fef22128-e607-4933-8a4b-40ab42a1bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:49.057169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:49.088094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:49.242127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:49.244655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:49.262659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:49.399198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99533704-876d-4648-aa14-03cde132c8a7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:49.505839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:49.533678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:49.534302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:49.534582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:49.534847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:49.536506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:49.628517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:49.630158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05baba9-3800-46e5-a1c0-dffb2318c423 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:49.648531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 718/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:50.481314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:50.482217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:50.482217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:50.484375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:50.489687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb375c-497c-4b9a-a705-63b4697025bd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:50.490152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb375c-497c-4b9a-a705-63b4697025bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:50.490249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb375c-497c-4b9a-a705-63b4697025bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:50.589811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f6cb375c-497c-4b9a-a705-63b4697025bd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:50.591027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6cb375c-497c-4b9a-a705-63b4697025bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:50.633745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:50.692107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:50.843201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:50.844781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:51.029283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb877-deb0-4083-b96a-821246da04d0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:51.088067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:51.162045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:51.162697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:51.162998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:51.163264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:51.165186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:51.258290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:51.260011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de064015-03be-4af6-b91a-a4822c5376fc service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:51.279244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 718/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:52.079055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:52.079961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:52.079961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:52.082071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:52.089195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d06a7-db3a-4074-8144-e5f0f166b066 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:52.089618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d06a7-db3a-4074-8144-e5f0f166b066 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:52.089726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d06a7-db3a-4074-8144-e5f0f166b066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:52.168969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b09d06a7-db3a-4074-8144-e5f0f166b066 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:52.170166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b09d06a7-db3a-4074-8144-e5f0f166b066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:52.172390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:52.283150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:52.436492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:52.439352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:52.603881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05665964-47bc-43c1-8110-72350f06ac40 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:52.633912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:52.727250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:52.727866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:52.728171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:52.728435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:52.730057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:52.822881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:52.824509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c589bf-5540-4fc6-b702-37f3033e2008 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:52.842708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 721/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:54.693924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:54.694776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:54.694776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:54.696796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:54.702360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8988f-b047-473d-9b2b-578e28d8aaeb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:54.702805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8988f-b047-473d-9b2b-578e28d8aaeb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:54.702936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8988f-b047-473d-9b2b-578e28d8aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:54.745547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:54.773664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0be8988f-b047-473d-9b2b-578e28d8aaeb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:54.774915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0be8988f-b047-473d-9b2b-578e28d8aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:54.874099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:15:55.154204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:55.155758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:55.282300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd6241-0e86-489d-b4cd-adf77b76e201 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:55.314565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:55.365388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:55.366556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:55.367149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:55.367719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:55.371346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:55.504477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:55.505829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65921887-dfeb-4d67-a1d1-aa2f5bb1321f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:55.527253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 721/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:15:57.631707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:57.632349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:57.632349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:57.634314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:15:57.639933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835b1d-08cb-458f-9383-d51bfaa8ccbe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:57.640384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835b1d-08cb-458f-9383-d51bfaa8ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:57.640492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2835b1d-08cb-458f-9383-d51bfaa8ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:57.712752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e2835b1d-08cb-458f-9383-d51bfaa8ccbe None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:15:57.713939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2835b1d-08cb-458f-9383-d51bfaa8ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:57.726470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:57.826207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:15:58.105585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:15:58.107996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:58.221975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b0cad-bbc4-49e5-99c3-c8da72d65bcc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:15:58.235946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:15:58.302644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:15:58.303256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:15:58.303531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:15:58.303799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:15:58.305561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:15:58.430826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:15:58.432312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7de826-c81c-41e8-9ae9-956f2426e572 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:15:58.451260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 724/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:00.720129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:00.721053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:00.721053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:00.723053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:00.729801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33de8d-caf2-4975-b040-14c061e98f83 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:00.730238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33de8d-caf2-4975-b040-14c061e98f83 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:00.730433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33de8d-caf2-4975-b040-14c061e98f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:00.798197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:00.817010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bb33de8d-caf2-4975-b040-14c061e98f83 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:00.818243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bb33de8d-caf2-4975-b040-14c061e98f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:01.051845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:01.341312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:01.343655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:01.456042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fab8ad-ffb7-4d3e-bd07-a140a53f8245 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:01.497380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:01.532839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:01.533444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:01.533731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:01.534038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:01.535575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:01.648855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:01.650279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18f531-364b-497e-a3e7-a82a5b76b371 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:01.669092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 724/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:03.764254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:03.764784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:03.764784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:03.766161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:03.771794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa03c7-3ec2-4ded-bb5a-25d08bac6284 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:03.772294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa03c7-3ec2-4ded-bb5a-25d08bac6284 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:03.772390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa03c7-3ec2-4ded-bb5a-25d08bac6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:03.845191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0eaa03c7-3ec2-4ded-bb5a-25d08bac6284 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:03.846470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0eaa03c7-3ec2-4ded-bb5a-25d08bac6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:03.871729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:03.957489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:16:04.251090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:04.252789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:04.362032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08456f-6007-40b9-9fce-8a0d81c2a318 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:04.390366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:04.449393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:04.450256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:04.450660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:04.451094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:04.452746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:04.572867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:04.574174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d6191-bfd9-464c-8f79-468cbfa25977 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:04.593193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 727/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:06.590778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:06.591379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:06.591379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:06.592700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:06.598264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33175-38bd-4471-a567-aa6b662f6e50 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:06.598689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33175-38bd-4471-a567-aa6b662f6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:06.598831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d33175-38bd-4471-a567-aa6b662f6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:06.673630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:06.677491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-95d33175-38bd-4471-a567-aa6b662f6e50 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:06.680126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-95d33175-38bd-4471-a567-aa6b662f6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:06.789608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:07.075215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:07.077729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:07.202296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf07fc-e2ff-41b5-8cc7-9ee7d1848943 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:07.251971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:07.283718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:07.284385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:07.284654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:07.284920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:07.286530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:07.410232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:07.411698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615809a6-a326-437e-8ae2-b2f528642c6e service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:07.431037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 727/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:09.421180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:09.422080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:09.422080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:09.424297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:09.430365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4317-78fd-455d-a8d1-4eb0fd51785b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:09.430788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4317-78fd-455d-a8d1-4eb0fd51785b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:09.430913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba4317-78fd-455d-a8d1-4eb0fd51785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:09.508842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-24ba4317-78fd-455d-a8d1-4eb0fd51785b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:09.509959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-24ba4317-78fd-455d-a8d1-4eb0fd51785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:09.541430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:09.617761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:09.902292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:09.904783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:10.039533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e60e9-e95f-471f-9aa9-4b3c524f35ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:10.070534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:10.126879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:10.127494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:10.127775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:10.128070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:10.129691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:10.248532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:10.249979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205940a-c169-4593-a2b9-5cf2bcc2ffbb service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:10.267687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 730/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:12.225383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:12.226096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:12.226096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:12.227411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:12.235543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898cb9-bcb5-4427-97d0-7b7302791d79 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:12.236410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898cb9-bcb5-4427-97d0-7b7302791d79 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:12.236410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce898cb9-bcb5-4427-97d0-7b7302791d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:12.308916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ce898cb9-bcb5-4427-97d0-7b7302791d79 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:12.310676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce898cb9-bcb5-4427-97d0-7b7302791d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:12.324367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:12.432489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:12.716252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:12.717821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:12.838629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96852fae-bc89-4c7f-9163-fc46875aab9d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:12.909769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:12.934440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:12.935048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:12.935317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:12.935582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:12.937233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:13.053441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:13.054894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63d3b7-def6-4273-9e2d-ade0655e2ebe service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:13.074493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 730/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:15.035726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:15.036617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:15.036617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:15.038543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:15.044169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded83ff-00c4-4032-9a4e-9acda48b9173 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:15.044616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded83ff-00c4-4032-9a4e-9acda48b9173 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:15.044712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded83ff-00c4-4032-9a4e-9acda48b9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:15.114366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7ded83ff-00c4-4032-9a4e-9acda48b9173 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:15.115575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ded83ff-00c4-4032-9a4e-9acda48b9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:15.169353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:15.250407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:15.532471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:15.534926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:15.651689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d89bed-c845-4eee-a58d-4053474e0d9d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:15.691286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:15.729304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:15.729944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:15.730210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:15.730503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:15.732197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:15.849141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:15.850677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e2849-ca6e-4cce-aa57-0ce63c565d58 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:15.869530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 733/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:17.815139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:17.815586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:17.815666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:17.818659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:17.823470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7226b-635f-4d7c-afbe-b2039fd3a315 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:17.823958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7226b-635f-4d7c-afbe-b2039fd3a315 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:17.824062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7226b-635f-4d7c-afbe-b2039fd3a315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:17.891148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6fa7226b-635f-4d7c-afbe-b2039fd3a315 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:17.892386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6fa7226b-635f-4d7c-afbe-b2039fd3a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:17.916340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:18.006807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:18.294923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:18.297461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:18.425317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b7d8-be4d-4dc6-9af2-1e070c2ba348 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:18.495790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:18.505592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:18.506448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:18.506718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:18.506972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:18.509367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:18.630918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:18.632885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e5578-9c37-4952-84f8-122977a7f8b2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:18.653055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 733/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:20.578107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:20.579046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:20.579227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:20.581448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:16:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:20.590572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301c3e-80b3-495f-88a7-753d30b411b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:20.591056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301c3e-80b3-495f-88a7-753d30b411b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:20.591574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301c3e-80b3-495f-88a7-753d30b411b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:20.677401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ea301c3e-80b3-495f-88a7-753d30b411b3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:20.679059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ea301c3e-80b3-495f-88a7-753d30b411b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:20.732678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:20.783251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:21.066357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:21.067943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:21.180883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b4d77-4b50-4de6-9039-a90a0cb8a5c7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:21.234262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:21.273851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:21.274471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:21.274739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:21.274997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:21.276667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:21.406235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:21.407703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15cf7-71fa-473c-b79d-c63c15fa6049 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:21.427246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 736/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:30.781344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=22 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:31.424588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=66 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:40.979136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba5d7-510f-4a4b-8f02-9786eacebb91 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:40.980122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba5d7-510f-4a4b-8f02-9786eacebb91 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:40.980122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ba5d7-510f-4a4b-8f02-9786eacebb91 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:40.982261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 735/1471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:40.990754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869641e7-2ccd-4789-b7c9-9361dcd87a1f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:40.991211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869641e7-2ccd-4789-b7c9-9361dcd87a1f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:40.991211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869641e7-2ccd-4789-b7c9-9361dcd87a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:41.064365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-869641e7-2ccd-4789-b7c9-9361dcd87a1f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:41.065568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-869641e7-2ccd-4789-b7c9-9361dcd87a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:41.171766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 737/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:41.484972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:41.485240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:41.485552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:41.487534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 736/1473] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 17 11:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:41.493091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2c68-a70e-44fc-8119-ac6c7eb4eab9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:41.493378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2c68-a70e-44fc-8119-ac6c7eb4eab9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:41.493648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2c68-a70e-44fc-8119-ac6c7eb4eab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:41.573442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-660d2c68-a70e-44fc-8119-ac6c7eb4eab9 None None] MFA Rules not processed for user `ded8007ff9d64b5b809eef243b8d7895`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:41.574669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-660d2c68-a70e-44fc-8119-ac6c7eb4eab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:41.596599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:41.657244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 738/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 17 11:16:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:41.665085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:41.666621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:41.778184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505efaef-15c4-4f1e-8749-feadb56df837 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:41.858068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:41.858670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:41.858940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:41.859205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:41.860830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:41.917864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:41.974862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:41.976337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab67fff-64de-43bf-ae82-80f00f5d9b3b service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:41.995324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 737/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:44.077391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:44.077947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:44.077947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:44.079216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 739/1476] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:44.085582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a547f-1f97-47e8-bc01-0abea1bd2116 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:44.086354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a547f-1f97-47e8-bc01-0abea1bd2116 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:44.086513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a547f-1f97-47e8-bc01-0abea1bd2116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:44.159709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-669a547f-1f97-47e8-bc01-0abea1bd2116 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:44.161087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-669a547f-1f97-47e8-bc01-0abea1bd2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:44.268587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 738/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:44.537277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:44.538816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:44.681234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9387-4ae8-43c6-bd32-77ec11af583e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:44.735376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:44.784022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:44.784634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:44.784906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:44.785177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:44.785862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:44.787754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:16:44.787754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:16:44.787754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:16:44.788876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01b473-94a4-4dea-8452-ca97a476a243 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:44.808466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 740/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 17 11:16:44 2022] GET /identity/v3/projects => generated 2553 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:16:46.711422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:46.712030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:46.712030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:46.714040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 739/1479] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:46.722821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8036e-5c5c-457a-a763-09a27f4c32d7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:46.723322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8036e-5c5c-457a-a763-09a27f4c32d7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:46.723667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8036e-5c5c-457a-a763-09a27f4c32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:46.798678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-12b8036e-5c5c-457a-a763-09a27f4c32d7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:46.799890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12b8036e-5c5c-457a-a763-09a27f4c32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:46.918804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 741/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:47.208549 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:47.210207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:47.220216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:47.373465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b23b3-8752-41c0-a4c1-a61a594fba73 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:47.463669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:47.499221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:47.499826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:47.500139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:47.500406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:47.502012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:47.593661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:47.595233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91124dfa-1622-42b7-afc4-d4c85ad653cc service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:47.614038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 740/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:49.722971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:49.724078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:49.724413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:49.726866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 742/1482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:49.732657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5b55d-d84f-4b20-879d-0baecba6e9a8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:49.733164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5b55d-d84f-4b20-879d-0baecba6e9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:49.733164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5b55d-d84f-4b20-879d-0baecba6e9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:49.802958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a8c5b55d-d84f-4b20-879d-0baecba6e9a8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:49.804171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a8c5b55d-d84f-4b20-879d-0baecba6e9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:49.851687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:49.902863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 741/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:50.199546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:50.201961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:50.233694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:50.317737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670edf8-7e00-450a-ae24-0fd0772ec8b6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:50.410514 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:50.411210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:50.411481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:50.411748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:50.413397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:50.500598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:50.538468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:50.539942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32888be-3d6b-44d0-b5df-46b54fbb5f9e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:50.558722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 743/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:52.564141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:52.564696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:52.564696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:52.566025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 742/1485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:52.572098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e81f-c5d2-43f2-829d-95ada6435472 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:52.572581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e81f-c5d2-43f2-829d-95ada6435472 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:52.572581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195e81f-c5d2-43f2-829d-95ada6435472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:52.649208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5195e81f-c5d2-43f2-829d-95ada6435472 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:52.650462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5195e81f-c5d2-43f2-829d-95ada6435472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:52.763820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 744/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:53.057420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:53.059891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:53.172470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bd384-d10c-4a89-ae93-464ae2413177 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:53.250104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:53.251782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:53.252488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:53.252771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:53.253065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:53.255541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:53.367461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:53.368941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d19167-5459-43c3-9200-a091253d818a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:53.389351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 743/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:55.468713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:55.469639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:55.469639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:55.471792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 745/1488] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:55.477733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7c75-b7d1-4ddb-8c42-1ebf7f5cce4d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:55.478160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7c75-b7d1-4ddb-8c42-1ebf7f5cce4d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:55.478287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7c75-b7d1-4ddb-8c42-1ebf7f5cce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:55.555267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e60b7c75-b7d1-4ddb-8c42-1ebf7f5cce4d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:55.557198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e60b7c75-b7d1-4ddb-8c42-1ebf7f5cce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:55.620251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:55.669318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 744/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:55.970538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:55.973790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:56.017817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:56.091757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5747cef-05b7-4b78-9bbb-cf83f09a1eb4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:56.169702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:56.170310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:56.170588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:56.170859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:56.172490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:56.258339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:56.290179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:56.291543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1df069-a615-4818-9fae-8383b417d229 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:56.310268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 746/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:16:58.414881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:58.415499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:58.415499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:58.416794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 745/1491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 17 11:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:16:58.422982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4776-e83a-4f67-a985-d22c33e0e232 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:58.423754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4776-e83a-4f67-a985-d22c33e0e232 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:58.423957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4776-e83a-4f67-a985-d22c33e0e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:58.498271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-304f4776-e83a-4f67-a985-d22c33e0e232 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:16:58.499502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-304f4776-e83a-4f67-a985-d22c33e0e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:58.609992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 747/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 17 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:16:58.894147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:16:58.896354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:59.025160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e100b5-9eb7-4e71-9476-1da0ef4a809a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:16:59.108304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:16:59.108916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:16:59.109190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:16:59.109461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:16:59.111080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:16:59.120945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:16:59.230414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:16:59.232773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d906-616e-4d6e-87cb-36e606fba3fa service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:16:59.261054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 746/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:17:08.608174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=82 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:17:09.258378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=50 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:10.710084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:10.711067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:10.711067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:10.799136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:18:10.800386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:10.908004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 748/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:18:10.913346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:10.913843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:10.913935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:10.997884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:18:10.999119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:11.102135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 747/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:18:11.107543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.108858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:11.120895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029c719-13ed-4171-b3ab-0165546758ca None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:11.194089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:11.231868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:11.232624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:11.233216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:11.233496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:11.234144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:18:11.234447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:11.235478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:11.235478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:18:11.235478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:18:11.236469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:11.248747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 749/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:18:11.257057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.267437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06492e-aa97-47d4-9b10-550fffc679e7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:11.335114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:11.371432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:11.372075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:11.372347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:11.372609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:11.373391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:11.375257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:11.375257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:18:11.375257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:18:11.376475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:11.437772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 748/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:18:11 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:18:11.442177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.443743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:11.476890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eff19-771e-48bf-bec2-4a1e2bc8f5ff admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:11.580241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:11.580763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:11.581044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:11.581297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:11.581927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:11.582948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:11.582948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:18:11.582948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:18:11.584189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:11.631292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 750/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:18:11 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:18:11.635753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.637404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:11.705870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac7ac9-0517-4542-8ec9-0b98993b28c5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:11.800587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:11.813263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:11.813915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:11.814190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:11.814460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:11.815111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:11.816184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:11.816184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:18:11.816184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:18:11.817087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:11.830594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:18:11.835070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.836636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:11.848804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b96111-29c8-4072-bfc0-8ce68d2aba64 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:11.875506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:11.952305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:11.952910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:11.953200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:11.953460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:11.954105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:11.955145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:11.955145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:18:11.955145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:18:11.956054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42de678-cbd7-45d0-8d90-3cc9ede79c8e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:11.968690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 751/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:18:11.973976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:11.976201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:12.019585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb7cff-58b2-45b6-8b47-afcf0b62b9a7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:12.132106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:12.132771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.133038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.133302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] PATH_INFO: `/v3/projects/34ea6db332cd4c2aa300d74266232473/users/d62e0e4ecc6f459aae455ad04fc54fea/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.159003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ea6db332cd4c2aa300d74266232473, user_id=d62e0e4ecc6f459aae455ad04fc54fea, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:12.160067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:12.160067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:18:12.160067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:18:12.161978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c062f-4a6d-4aec-80b6-baf587b0d229 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:12.196231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 750/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:18:11 2022] PUT /identity/v3/projects/34ea6db332cd4c2aa300d74266232473/users/d62e0e4ecc6f459aae455ad04fc54fea/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:18:12.209299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07776a-d241-4ec9-ad77-e458b210938f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.209586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07776a-d241-4ec9-ad77-e458b210938f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.209863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07776a-d241-4ec9-ad77-e458b210938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.269174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ea07776a-d241-4ec9-ad77-e458b210938f None None] MFA Rules not processed for user `d62e0e4ecc6f459aae455ad04fc54fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:18:12.270412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea07776a-d241-4ec9-ad77-e458b210938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:12.349874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 752/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:18:12.363940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.364253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.364525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.365885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 751/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 17 11:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:18:12.370785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e113-cd42-4eaa-9754-0c3a7f168c33 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.371069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e113-cd42-4eaa-9754-0c3a7f168c33 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.371340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e113-cd42-4eaa-9754-0c3a7f168c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.406568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:12.466185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3dd4e113-cd42-4eaa-9754-0c3a7f168c33 None None] MFA Rules not processed for user `4d42cfa2d2e9453d879c623cae849ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:18:12.467532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3dd4e113-cd42-4eaa-9754-0c3a7f168c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:12.548493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 753/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 17 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:18:12.556717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:12.558244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:12.611315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:12.673145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c645d-3224-4797-8913-0e44e213ebd5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:12.752737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:12.753351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.753622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.753885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.755478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:12.867629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:12.869162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:12.872661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:12.889525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 752/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:18:12.937721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e063-17b6-4d02-8703-c2fce2d7b670 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:12.938173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e063-17b6-4d02-8703-c2fce2d7b670 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:12.938284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e063-17b6-4d02-8703-c2fce2d7b670 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:12.939662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 754/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Aug 17 11:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:18:12.943446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:12.944738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:13.053372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ac444-3970-488b-a1d0-4b73bf5b7718 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:13.155865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:13.156935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:13.157233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:13.157605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] PATH_INFO: `/v3/users/d62e0e4ecc6f459aae455ad04fc54fea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:13.174785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62e0e4ecc6f459aae455ad04fc54fea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:13.175759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:13.175759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:18:13.175759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:18:13.177002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:13.187093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:13.246612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62e0e4ecc6f459aae455ad04fc54fea'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:13.257810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62e0e4ecc6f459aae455ad04fc54fea'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:13.258347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62e0e4ecc6f459aae455ad04fc54fea'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:13.272866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62e0e4ecc6f459aae455ad04fc54fea'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:13.297575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62e0e4ecc6f459aae455ad04fc54fea'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:13.303591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 753/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:18:12 2022] DELETE /identity/v3/users/d62e0e4ecc6f459aae455ad04fc54fea => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:18:13.308333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660276-e538-410a-acda-e159704b285c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:13.308617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660276-e538-410a-acda-e159704b285c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:13.308892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d660276-e538-410a-acda-e159704b285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:13.369129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3d660276-e538-410a-acda-e159704b285c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:18:13.370343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3d660276-e538-410a-acda-e159704b285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:13.453507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:13.467579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 755/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:18:13.477530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:13.478801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:13.591245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed09e1-37c1-42c3-a2dd-3ab4ea1aee7f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:13.652435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:13.675616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:13.676591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:13.676974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:13.677337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:13.679908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:13.804086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:13.805693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac1b4f-116e-45f8-ae8c-265dd122c7b3 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:13.828592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 754/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:18:14.191859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660276-e538-410a-acda-e159704b285c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:18:14.193127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3d660276-e538-410a-acda-e159704b285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:18:14.205151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d660276-e538-410a-acda-e159704b285c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:18:14.313968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:18:14.314532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:18:14.314812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:18:14.315080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] PATH_INFO: `/v3/projects/34ea6db332cd4c2aa300d74266232473` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:18:14.325651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ea6db332cd4c2aa300d74266232473)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:18:14.326701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:18:14.326701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:18:14.326701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:18:14.327940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:18:14.390386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ea6db332cd4c2aa300d74266232473', 'request_id': 'req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:14.401913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ea6db332cd4c2aa300d74266232473', 'request_id': 'req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:14.417255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ea6db332cd4c2aa300d74266232473', 'request_id': 'req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:14.439546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] The token cache is being invalidate because project 34ea6db332cd4c2aa300d74266232473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:18:14.439832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:14.440376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6b83bdc8-8412-4d7a-ac7a-64e972cc2fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:18:14.441676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 756/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:18:14 2022] DELETE /identity/v3/projects/34ea6db332cd4c2aa300d74266232473 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:18:23.825713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=62 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:18:24.437602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:49.656370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:49.657041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:49.657041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:49.658281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:19:49.664278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d11-4a59-4be4-bb57-a87dd5bc4491 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:49.665039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d11-4a59-4be4-bb57-a87dd5bc4491 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:49.665225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45d11-4a59-4be4-bb57-a87dd5bc4491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:49.749747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e1b45d11-4a59-4be4-bb57-a87dd5bc4491 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:19:49.751074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e1b45d11-4a59-4be4-bb57-a87dd5bc4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:19:49.865235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:19:50.021542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:19:50.025587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:19:50.168724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5672e6f-c018-4482-bab3-fab5cc38beec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:19:50.174614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:19:50.175239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:50.175578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:50.175850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:50.184208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:19:50.185810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2f79-896e-4c78-b992-d8b85c03e636 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:19:50.195099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 756/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:19:51.040645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67350d0-c03f-480c-b75a-4101bb85b5ce None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:51.041505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67350d0-c03f-480c-b75a-4101bb85b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:51.041505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67350d0-c03f-480c-b75a-4101bb85b5ce None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:51.043419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:19:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:19:51.051606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713621-a196-41a4-9fc7-23a45803e1c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:51.052374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713621-a196-41a4-9fc7-23a45803e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:51.052568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713621-a196-41a4-9fc7-23a45803e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:51.075353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb713621-a196-41a4-9fc7-23a45803e1c8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:19:51.076579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb713621-a196-41a4-9fc7-23a45803e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:19:51.086052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:19:51.244956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67350d0-c03f-480c-b75a-4101bb85b5ce None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:19:51.265713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67350d0-c03f-480c-b75a-4101bb85b5ce None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:19:51.271663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:19:51.272292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:51.272564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:51.272832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:51.281330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:19:51.282923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c498fb-91f2-41cf-8028-83e9e1a3cb15 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:19:51.292920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 759/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:19:51.422854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2afd1-819c-42a2-a932-03b549343ed7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:51.423114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2afd1-819c-42a2-a932-03b549343ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:51.423412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2afd1-819c-42a2-a932-03b549343ed7 None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:51.424762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 758/1517] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 17 11:19:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:19:51.432364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f650-d51e-4989-aa22-f7fae9a58680 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:19:51.432652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f650-d51e-4989-aa22-f7fae9a58680 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:19:51.432921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9f650-d51e-4989-aa22-f7fae9a58680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:19:51.497474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-25c9f650-d51e-4989-aa22-f7fae9a58680 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:19:51.498684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25c9f650-d51e-4989-aa22-f7fae9a58680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:19:51.516297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:19:51.576305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 760/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:00.599421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7697-0b06-4896-9c6b-e2159b792174 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:00.600354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7697-0b06-4896-9c6b-e2159b792174 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:00.600354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef7697-0b06-4896-9c6b-e2159b792174 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:00.602408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 759/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 17 11:20:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:00.608600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079c16-2fe8-47f4-b44c-d930ea77d9f6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:00.609375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079c16-2fe8-47f4-b44c-d930ea77d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:00.609545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079c16-2fe8-47f4-b44c-d930ea77d9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:00.631900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-db079c16-2fe8-47f4-b44c-d930ea77d9f6 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:00.633144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-db079c16-2fe8-47f4-b44c-d930ea77d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:00.643891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 761/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 17 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:00.651951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef7697-0b06-4896-9c6b-e2159b792174 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:00.667486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef7697-0b06-4896-9c6b-e2159b792174 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:00.673045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:00.673639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:00.673941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:00.674219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:00.682590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:00.684216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a45edc-c3ce-4f69-96fc-0d99563468f1 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:00.693874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 760/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:02.560336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868dc0-9734-4432-b3a5-2b161ff6c09e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:02.560950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868dc0-9734-4432-b3a5-2b161ff6c09e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:02.560950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868dc0-9734-4432-b3a5-2b161ff6c09e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:02.562257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:02.568638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b4b1-3516-47de-a946-9e70d1bd5c2b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:02.569305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b4b1-3516-47de-a946-9e70d1bd5c2b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:02.569489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b4b1-3516-47de-a946-9e70d1bd5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:02.600948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2ff2b4b1-3516-47de-a946-9e70d1bd5c2b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:02.602777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ff2b4b1-3516-47de-a946-9e70d1bd5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:02.616372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:02.772840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868dc0-9734-4432-b3a5-2b161ff6c09e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:02.789551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38868dc0-9734-4432-b3a5-2b161ff6c09e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:02.795615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:02.796245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:02.796521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:02.796790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:02.805848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:02.807428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9d838-9d46-4b56-aaaf-42d95fe8d900 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:02.817037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 763/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:03.646018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b3fd-a067-4ea8-9c6d-7e2a352247aa None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:03.646964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b3fd-a067-4ea8-9c6d-7e2a352247aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:03.647402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3b3fd-a067-4ea8-9c6d-7e2a352247aa None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:03.648814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 11:20:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:03.656920 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a620-8693-4a54-ba70-65f090e9ffa8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:03.657390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a620-8693-4a54-ba70-65f090e9ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:03.657497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a620-8693-4a54-ba70-65f090e9ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:03.678534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c926a620-8693-4a54-ba70-65f090e9ffa8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:03.679742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c926a620-8693-4a54-ba70-65f090e9ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:03.690786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:03.839833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b3fd-a067-4ea8-9c6d-7e2a352247aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:03.857659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3b3fd-a067-4ea8-9c6d-7e2a352247aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:03.863734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:03.864339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:03.864618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:03.864869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:03.873727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:03.875341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904636a-bbcf-40ea-ab81-7ebc64b3238f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:03.885458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 763/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:07.630070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:07.631002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:07.631002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:07.633061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:07.638845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20219c6-afe4-4f63-8606-c3c23829b094 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:07.639305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20219c6-afe4-4f63-8606-c3c23829b094 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:07.639409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20219c6-afe4-4f63-8606-c3c23829b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:07.659474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f20219c6-afe4-4f63-8606-c3c23829b094 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:07.660778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f20219c6-afe4-4f63-8606-c3c23829b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:07.669483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:07.963270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:07.966380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:08.069681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8e35-ea44-4001-b5da-31582e3563d6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:08.074112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:08.074724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:08.075004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:08.075257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:08.084872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:08.086310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5507d-9481-4289-a989-8dea351d42d1 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:08.096453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 766/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:10.062747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f720-acfe-4ed0-acff-45d8590d8916 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:10.063588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f720-acfe-4ed0-acff-45d8590d8916 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:10.063588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402f720-acfe-4ed0-acff-45d8590d8916 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:10.065717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:20:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:10.072253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a5f2-279c-4794-8ba0-9ec3a2e66b36 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:10.072726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a5f2-279c-4794-8ba0-9ec3a2e66b36 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:10.072836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58a5f2-279c-4794-8ba0-9ec3a2e66b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:10.101071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1b58a5f2-279c-4794-8ba0-9ec3a2e66b36 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:10.102272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b58a5f2-279c-4794-8ba0-9ec3a2e66b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:10.110061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:10.392443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f720-acfe-4ed0-acff-45d8590d8916 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:10.411626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402f720-acfe-4ed0-acff-45d8590d8916 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:10.415862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:10.416497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:10.416767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:10.417036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:10.426799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:10.428266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420852c2-b5fd-42cd-8a00-a3612b95b3d9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:10.438155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 766/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:13.823062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:13.824007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:13.824007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:13.826112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:13.832534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82d1-fe0b-49d6-ac77-73eb08a17d75 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:13.833337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82d1-fe0b-49d6-ac77-73eb08a17d75 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:13.833492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed82d1-fe0b-49d6-ac77-73eb08a17d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:13.846886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:20:13.867205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-96ed82d1-fe0b-49d6-ac77-73eb08a17d75 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:13.868909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96ed82d1-fe0b-49d6-ac77-73eb08a17d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:13.881819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:14.430113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:14.432872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:14.513627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:20:14.527783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a1735-8c18-44ee-97d7-e203521b4e1c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:14.531426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:14.532062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:14.532334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:14.532601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:14.541565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:14.542988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645bd6c-bd3c-48c9-87ce-9e1466318858 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:14.552339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 769/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:16.512466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:16.513070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:16.513070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:16.514336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 11:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:20:16.520273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8dc21-56cf-4e62-99eb-72bf12f9810f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:16.520745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8dc21-56cf-4e62-99eb-72bf12f9810f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:16.520841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8dc21-56cf-4e62-99eb-72bf12f9810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:16.542810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-60a8dc21-56cf-4e62-99eb-72bf12f9810f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:20:16.544016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-60a8dc21-56cf-4e62-99eb-72bf12f9810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:16.555050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:20:17.123258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:20:17.125455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:20:17.141261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8054ab-a235-47c0-afec-c3c31f5d4bc9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:20:17.145663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:20:17.146258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:20:17.146533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:20:17.146804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:20:17.156711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:20:17.158149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c10e4e-d91f-47db-8e37-53a5e23d75f4 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:20:17.168220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 769/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:20:26.537887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=11 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:20:27.164363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:50.132385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae947-63a8-4af5-b978-2ea1e9f9eba7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.133122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae947-63a8-4af5-b978-2ea1e9f9eba7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.133122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ae947-63a8-4af5-b978-2ea1e9f9eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.148018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647a31-6dcd-4f80-adb8-9d50259b0682 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.149080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647a31-6dcd-4f80-adb8-9d50259b0682 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.149578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647a31-6dcd-4f80-adb8-9d50259b0682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.157357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6d2ae947-63a8-4af5-b978-2ea1e9f9eba7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.158662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6d2ae947-63a8-4af5-b978-2ea1e9f9eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.173644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 771/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.188982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fa647a31-6dcd-4f80-adb8-9d50259b0682 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.191300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa647a31-6dcd-4f80-adb8-9d50259b0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.194643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.194922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.195190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.207141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 770/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.218098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.218808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.219335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.226073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.227299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.243567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 772/1542] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.244925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.251773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.255248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38347e06-86c8-41fd-b0a4-ec886e817432 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.255489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.266547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.268975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.270412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.271408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.272822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 771/1543] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:21:50.273311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:50.273998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.280965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.285066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.299326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1c2e7-de70-4147-85e2-ae0d1035b24b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.312716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 773/1544] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:50.315769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.317041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.317557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.318060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.318999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:50.319606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.321074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:50.321074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:21:50.321074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:21:50.322514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.329919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.346202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad471e-321c-4ad8-90d6-09e3871f1eed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.359710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 772/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:50.365530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.366905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.367489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.368219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.369153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.370519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:50.370519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:21:50.370519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:21:50.372250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.391981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.405856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eb112-b938-49a4-aa29-9f1a035b09b7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.420096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.421166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.421841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.423228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.424128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.426916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.460803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 774/1546] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:21:50.462636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.496008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 773/1547] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/projects => generated 353 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:21:50.497028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.591494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83f887-e75f-4fd0-bacb-fcbc1dfc55e2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.605018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc001c2-8b37-4a26-a813-2111a506fc0e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.608849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.609492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.609767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.610036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.610670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.611699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:50.611699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:21:50.611699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:21:50.613800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50979c3c-aee9-4b52-84ee-610d02f4db71 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.625777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.626615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.626896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.627163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.627853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.630490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c72f9-e0d3-4724-814f-cdea266622d0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.683638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 774/1548] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/users => generated 277 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:50.685046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.685330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.685602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.696188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 775/1549] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:50.699846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668980e7-659c-4bc6-a0ab-809edc8b0dd4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.700382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668980e7-659c-4bc6-a0ab-809edc8b0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.700664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668980e7-659c-4bc6-a0ab-809edc8b0dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.717521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.720334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.723422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-668980e7-659c-4bc6-a0ab-809edc8b0dd4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.725502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-668980e7-659c-4bc6-a0ab-809edc8b0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.741437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 776/1550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.741573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 775/1551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.742450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.742671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.743731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.744082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.753995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c91dc-05bd-40eb-a2d8-73a7c71e4abc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.758726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.759329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.759607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.759878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.760562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.762192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a3e65-68f9-4958-a7fc-46cac3479c96 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.766217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.767403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.773021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 776/1552] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:50.775398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b2c6-aa82-47fc-b9d1-adb4343b8a4c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.783258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 777/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.783258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.783455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b2c6-aa82-47fc-b9d1-adb4343b8a4c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.783455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b2c6-aa82-47fc-b9d1-adb4343b8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.785752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04811d8b-8392-4714-be02-cc51ea43dcdf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.790327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.790921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.791193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.791458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.792125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.793720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb6e57-6938-40a8-8a98-059a029930d5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.797598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8360b2c6-aa82-47fc-b9d1-adb4343b8a4c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.798815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8360b2c6-aa82-47fc-b9d1-adb4343b8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.803878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 778/1554] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:50.805216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2027-5afc-4d86-8a99-e70d026f965b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.805656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2027-5afc-4d86-8a99-e70d026f965b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.806074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2027-5afc-4d86-8a99-e70d026f965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.807472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 777/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.808714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35f66-1453-4c59-b18e-f1491c80b474 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.809006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35f66-1453-4c59-b18e-f1491c80b474 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.809274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35f66-1453-4c59-b18e-f1491c80b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.828894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9bf35f66-1453-4c59-b18e-f1491c80b474 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.830080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9bf35f66-1453-4c59-b18e-f1491c80b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.831513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3acc2027-5afc-4d86-8a99-e70d026f965b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.832810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3acc2027-5afc-4d86-8a99-e70d026f965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.838350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 778/1556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.839498 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.839772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.840069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.845229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 779/1557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.847320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb3d7-f7c1-48cd-a118-93af9f1e03dc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.847650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb3d7-f7c1-48cd-a118-93af9f1e03dc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.847950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bb3d7-f7c1-48cd-a118-93af9f1e03dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.866181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.867387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.867886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d26bb3d7-f7c1-48cd-a118-93af9f1e03dc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.869152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d26bb3d7-f7c1-48cd-a118-93af9f1e03dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.875744 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 779/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.876562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.877001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 780/1559] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.878256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.878535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.879172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.892757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b673a-5fc2-4ccd-981c-e2e3de690d8e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.898389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.898990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.899262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.899473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.899607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.900195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.901327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.901785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d131790-1545-41d4-ba7c-36e103bf5915 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.910330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 781/1560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.911716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.915483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 780/1561] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:50.915483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb594f-7c2c-4276-9bb7-9a440b5a11cd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.915483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb594f-7c2c-4276-9bb7-9a440b5a11cd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.915483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb594f-7c2c-4276-9bb7-9a440b5a11cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.925603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f51c6-9365-4640-b132-6bcb7dee9997 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.930505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.931103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.931377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.931647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.932323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.932990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-05cb594f-7c2c-4276-9bb7-9a440b5a11cd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.933915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2865-ee59-4a09-972b-aad438650bde admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.934164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-05cb594f-7c2c-4276-9bb7-9a440b5a11cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.942061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 781/1562] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.943210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.943486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.943775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.947388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 782/1563] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:50.947388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.947388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.947388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.963822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.965011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:50.965147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.966175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:50.974325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 783/1564] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.974726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 782/1565] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:50.975572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.978662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:50.985786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636b53d-ddb3-43c2-949c-9cdf98cfb1ab None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.988834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b149e24-a00c-4a67-aeeb-cfe481ffe19c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:50.991171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.991774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.992083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.992353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.992993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:50.993290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.993393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:50.993918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:50.994194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:50.994460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:50.994887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:50.995093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:50.995387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:50.996986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.007619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 783/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.008448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.010213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 784/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.011062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.018500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f404-004e-4c61-8f24-712179bb6fef admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.021287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2b2c-ab8d-4ea3-82ee-c5e4e6ab1c96 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.024038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.024637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.024915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.025185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.025825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:51.026124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.027152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.027722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.027825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.028096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.028365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] PATH_INFO: `/v3/projects/ea5e5772c145441fb604ca6f3d184f39/users/bdf393888f5d449b9e06efc40b50f155/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.040509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 784/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.041312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.043895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5e5772c145441fb604ca6f3d184f39, user_id=bdf393888f5d449b9e06efc40b50f155, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.044974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:51.044974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:21:51.044974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:21:51.046890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.049300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.058698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2ecf3-c4c9-48dd-b188-b80eda99a9fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.062249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 785/1569] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:51 2022] PUT /identity/v3/projects/ea5e5772c145441fb604ca6f3d184f39/users/bdf393888f5d449b9e06efc40b50f155/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:51.063215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.068348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.118117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.118639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.118912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.119179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.119819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:51.120144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.121748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.125535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff9a9-d720-4dd8-b4bd-33b940fadfba admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.131160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.131823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.132129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.132427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] PATH_INFO: `/v3/projects/242836f9e47f4afbbc3f70c14eebc846/users/652575a6004a45db9b7db7a9a36aca4a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.133803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 785/1570] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.134730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.147227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=242836f9e47f4afbbc3f70c14eebc846, user_id=652575a6004a45db9b7db7a9a36aca4a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.149919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.150120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778d52c-1690-42cb-9896-5afd340c83fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.155474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.156220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.156596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.156862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.157501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:51.157799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.159757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.163361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 786/1571] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:51 2022] PUT /identity/v3/projects/242836f9e47f4afbbc3f70c14eebc846/users/652575a6004a45db9b7db7a9a36aca4a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:51.164275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.172770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 786/1572] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.173418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.184696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e235ca-7a81-4463-be6b-9c03a61f2bab admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.233515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185ebc3-ef54-4566-b8a0-68a31efd81ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.238386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.238992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.239271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.239533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.240221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:21:51.240512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.242100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.243236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.244055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.244782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.245064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.245695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.247557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.253926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 787/1573] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:21:51.260797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.271530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fc93a-db5d-4202-914a-37377df62d6c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.276368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.276968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.277237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 787/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.277564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.277869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.278033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.278558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.280552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc450e9d-071b-43f7-a142-d4b48ff04f96 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.310529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 788/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.312293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.312575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.312846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.340757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] MFA Rules not processed for user `bdf393888f5d449b9e06efc40b50f155`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:51.341988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:51.349109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65c880-5054-4c34-8e71-0ea852a988af admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.373058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.381100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.413140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 789/1576] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:51.413370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.413511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.413612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.413612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.413612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.413612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.414973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335641d-8523-4dc1-bc0b-2d6b79291620 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.421519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeda40-49ad-4447-9ce2-1c68203b3562 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.426626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.427245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.427523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.427791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.428475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.430360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.444073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 788/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.446008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.446483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.446937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.465902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 790/1578] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.465902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.472723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:51.474438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:51.527975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00abb-19ac-48cf-a691-2422b573f106 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.532880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.533559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.533833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.534163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.535561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.537496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.553743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 789/1579] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:51.555048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.568786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf1e74-77e3-4d25-bbd3-1cf9a657f670 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.571572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 791/1580] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.572423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.574604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.575457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.575841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.576240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.577067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.580040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.610922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 790/1581] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.612247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.639416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4c82-ca4f-4083-a4cc-3e0c83540088 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.678779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39daec-d509-4868-ae7f-c5fdc12771e2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.683658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.684307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.684592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.684855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.685476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.687390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.687576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.701434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.702185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.702467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.702780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.703579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.705544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.709145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 791/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.709810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.721106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaa45b-2eea-4356-ac9e-caad396c3867 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.726579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.727223 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.727501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.727773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.728436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.730386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.731841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 792/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.732671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.743466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce144a-b1f5-4aad-bc0d-28d8e4c3093d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.748340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.748942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.749221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.749495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.750154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.752289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.756550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:51.768049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 792/1584] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.769731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.774886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 793/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.775696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.777443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:51.833331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bfa28-425c-4b53-80d3-9d987667c730 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.834829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52d07d-8aa5-463f-9884-26b3e7e7a588 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.837980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.838595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.838873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.839143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.839772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.841726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.864542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 793/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.865516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.875371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1383f-de10-4e9e-973e-b6c14aa07364 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.881280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.881875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.882257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.882533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.883171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.885096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.888754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.889369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.889714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.889889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.899477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.901067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.907680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 794/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 301 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.908585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.912676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 794/1588] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:51.913502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.918984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73715e2-e012-4273-8a22-9dfb019cbe72 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.923437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298dd2-83af-4e58-818c-29730dbb1216 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.923982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.924782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.925063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.925331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.925959 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.927864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.929672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.930597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.931115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.931613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.932542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.934544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.946835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 795/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:51.947637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.954948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 795/1590] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:51.956234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.958325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c376fc-c87f-4b87-8a45-3e6e5038fef0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.963717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.964416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.964681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.964952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.965621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.966247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd07ae-64d1-4c49-9b7e-41099af202c7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.967270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.972531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.973145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.973426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:51.973697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:51.974324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:51.976269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:51.981628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 796/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:51.981628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:51.993307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577c7d-6606-4315-8b66-a29e911a2fd7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:51.998859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:51.999495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:51.999777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.000223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.000868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.002495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.008112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 796/1592] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:51 2022] POST /identity/v3/users => generated 284 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:52.009452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.019954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 797/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.020596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.025745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967086b-27a8-4e58-94d2-55137ef93032 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.030657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.031286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.031688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.031992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.032644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.034842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.036107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0ddf-a247-4e2f-bdef-45d6be58e9e0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.041425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.041425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.042299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.042299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.042758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.044299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.047420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 797/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.048509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.062039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229535-1d29-4b2c-8a87-de97fb3bf911 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.067427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 798/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.068745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.071954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.072649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.072952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.073195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.073893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.075813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.081795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87169041-a05d-40a0-8710-0c11f0a8d42b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.087741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.088065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 798/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.088636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.088915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.089047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.089323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.090084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.091809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.099354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bfbf-f093-4e4f-890f-7d225172331b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.103506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 799/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.104510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.107155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.108079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.108566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.109493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.110370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.112412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.117618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9515d-27ef-4600-b99f-a4633299475c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.123474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.124277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.124697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.125143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.126226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.131313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 799/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.131483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.131585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.142875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 800/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.144061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.146519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47929-322b-4386-924f-f7bbeb744b58 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.151480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.152145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.154669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.154669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.154669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.154887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b5c9-7c32-4d9c-89c3-a7f78c6c68ae admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.154966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.158788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.159408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.159690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.159990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.160641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.162250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.170371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 800/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.171304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.173245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 801/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.177255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.182461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:52.182874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eea140-f301-4b22-9abc-ac1b007ef592 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.187736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a04b9c-2d3c-496e-8628-f82963c8c8ce admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.188153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.188996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.189175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.189484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.190232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.192123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.194475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.195278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.195960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.196476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] PATH_INFO: `/v3/projects/b2d15d31842545709cb4b23cca72e3a0/users/83cdff24514c42679e46d8f5b7c27fbe/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.204339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 801/1602] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.204339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.213565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d15d31842545709cb4b23cca72e3a0, user_id=83cdff24514c42679e46d8f5b7c27fbe, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.216662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.230229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c222db-c08c-486c-8dd3-b9e75fd74898 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.238556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 802/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/b2d15d31842545709cb4b23cca72e3a0/users/83cdff24514c42679e46d8f5b7c27fbe/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.238556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.303078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:52.314818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39ca34-88ea-40b7-aa35-dba226cbd9fa admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.320104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.321005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.321256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.321632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] PATH_INFO: `/v3/projects/6260890a43ff486598915092afc85446/users/9c06d5a51e984f36879bbb86b6d60513/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.339078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.339766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.340128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.340450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.341393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6260890a43ff486598915092afc85446, user_id=9c06d5a51e984f36879bbb86b6d60513, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.344818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.352791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.357274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.370112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/6260890a43ff486598915092afc85446/users/9c06d5a51e984f36879bbb86b6d60513/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.371189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.381836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 802/1605] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.382979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.405942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733a9f-dd42-4efc-b290-0cc58fe200b6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.459472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e8eac-9829-4459-9ef5-bf348bed3b48 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.464629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.465301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.465586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.465979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] PATH_INFO: `/v3/projects/f80f9a46d072465caf6fd124d23cfa62/users/2e6b9577faec4dc2932b6de4a85d5d61/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.475094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.475882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.476395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.476678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] PATH_INFO: `/v3/projects/06a2d962d36f436cb4ca66767f58f82d/users/7f72ad3badd74c7b98d650c76f6da43f/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.483537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80f9a46d072465caf6fd124d23cfa62, user_id=2e6b9577faec4dc2932b6de4a85d5d61, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.486734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.493927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a2d962d36f436cb4ca66767f58f82d, user_id=7f72ad3badd74c7b98d650c76f6da43f, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.497119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.504949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 804/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/f80f9a46d072465caf6fd124d23cfa62/users/2e6b9577faec4dc2932b6de4a85d5d61/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.505596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.515824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 803/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/06a2d962d36f436cb4ca66767f58f82d/users/7f72ad3badd74c7b98d650c76f6da43f/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.516746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.569145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:52.588827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeb2fc-d578-4ded-b60f-2d324cb84094 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.594464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb2e01-92d4-44aa-b3c7-3212becba80b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.595562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.596701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.597051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.597407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] PATH_INFO: `/v3/projects/f800aa7badcb4386b3e23ca9b59cd886/users/fc564035b8ee4029a9caced9064f69cb/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.600533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.602077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.602370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.602642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] PATH_INFO: `/v3/projects/2645ed72247c45eea508904193a0780e/users/83e1f7d7b47043948007165732eb0b5c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.620529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f800aa7badcb4386b3e23ca9b59cd886, user_id=fc564035b8ee4029a9caced9064f69cb, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.620913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2645ed72247c45eea508904193a0780e, user_id=83e1f7d7b47043948007165732eb0b5c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.623770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ad1a3-40b7-49d1-be47-31d3e5c8cf06 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.624202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca4697-a9f4-42b4-a46b-9c01e9877f52 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.644430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 805/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/f800aa7badcb4386b3e23ca9b59cd886/users/fc564035b8ee4029a9caced9064f69cb/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.645845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.646176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.646501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.650755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 804/1609] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/2645ed72247c45eea508904193a0780e/users/83e1f7d7b47043948007165732eb0b5c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.652332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.652609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.652868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.676596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:52.678533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:52.681646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:52.682955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:52.766670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:52.810931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 805/1610] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:52.812819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.816208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 806/1611] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:52.817112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:52.837953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263739ed-adaf-4d9d-950f-53a02efb4b71 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.851127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.852184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.852458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.852725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.853378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.854580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d470d-fc44-4f6d-a60b-f68fd332f82a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:52.856619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8945-bd86-486e-9903-fea51107bd68 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.862916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:52.864551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.865046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.865556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] PATH_INFO: `/v3/projects/bf2e5982630141ddb3a875791ec8848c/users/9f85bd65761a4a93a233310e9d996bba/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.874693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 807/1612] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:52.874693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b73-3b59-40a5-8cad-035d4594a36c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.874693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b73-3b59-40a5-8cad-035d4594a36c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.874693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12340b73-3b59-40a5-8cad-035d4594a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.892996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2e5982630141ddb3a875791ec8848c, user_id=9f85bd65761a4a93a233310e9d996bba, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:52.896410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46363101-0cd7-487b-a9dd-e0e92cb81b12 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:52.906416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-12340b73-3b59-40a5-8cad-035d4594a36c None None] MFA Rules not processed for user `7f72ad3badd74c7b98d650c76f6da43f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:52.907966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12340b73-3b59-40a5-8cad-035d4594a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:52.921402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 806/1613] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:52 2022] PUT /identity/v3/projects/bf2e5982630141ddb3a875791ec8848c/users/9f85bd65761a4a93a233310e9d996bba/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:52.922678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:52.922971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:52.923249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:52.946010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:52.947567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:53.013216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 808/1614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.013216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.013216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.013216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.040852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:53.043335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:53.044157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 807/1615] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.045001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.056419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 809/1616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.057339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.112927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545301-0089-4075-9c9a-ec00085ac82c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.117351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.118087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.118464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.118833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.119523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:53.130591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.132497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.141194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef3fa9-f0e5-466a-824c-55be97e863e6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.145552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.146191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 808/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:53.146962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.147336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.147632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.148104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.158215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056836-c54e-4e98-8903-58bcacc01358 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.160793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.162870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061adb6b-1245-4c5b-a3ba-e5674cf70892 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.165099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.166251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.166738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.167418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] PATH_INFO: `/v3/projects/f80f9a46d072465caf6fd124d23cfa62/users/2e6b9577faec4dc2932b6de4a85d5d61/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.170468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80f9a46d072465caf6fd124d23cfa62, user_id=2e6b9577faec4dc2932b6de4a85d5d61, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.173642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.174095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 810/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:53.175455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.175746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.176111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.190448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 809/1619] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:53 2022] PUT /identity/v3/projects/f80f9a46d072465caf6fd124d23cfa62/users/2e6b9577faec4dc2932b6de4a85d5d61/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:53.192359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.209407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] MFA Rules not processed for user `9f85bd65761a4a93a233310e9d996bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:53.209919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:53.276575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:53.286694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 811/1620] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.287584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.303472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eeafc-ce2b-43c6-a8b0-f42c28d28197 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.311478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.313650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.319046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.319747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.320737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.324654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.355086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519d9f5-4e4c-4394-8385-934d0bc9697d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.359229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.359955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.360680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.361533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.369827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 810/1621] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:53.369827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.377347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.379622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eadfc6-958b-498f-8c48-5eea0c446e9b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.391358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 812/1622] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:53.392684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1b63-c665-48e8-ae40-7d99c7938a99 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.394305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1b63-c665-48e8-ae40-7d99c7938a99 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.394798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1b63-c665-48e8-ae40-7d99c7938a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.429950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-44dd1b63-c665-48e8-ae40-7d99c7938a99 None None] MFA Rules not processed for user `2e6b9577faec4dc2932b6de4a85d5d61`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:53.431149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-44dd1b63-c665-48e8-ae40-7d99c7938a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:53.450618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aef41-9c58-4ce0-a430-78be9aac9ca2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.455076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.456286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.457277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.457648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.546871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:53.563318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 813/1623] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.563318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc154e-fcc0-4174-a890-792252c8b5d7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.563318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc154e-fcc0-4174-a890-792252c8b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.563318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc154e-fcc0-4174-a890-792252c8b5d7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.566429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.569796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063a42d-b241-4cc5-8ed5-39ceb1a8feab service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.570917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 814/1624] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 17 11:21:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:21:53.572315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc154e-fcc0-4174-a890-792252c8b5d7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.584443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 811/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:53.585833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.586265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.586709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.589956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc154e-fcc0-4174-a890-792252c8b5d7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.596358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.597946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.597946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.597946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.598797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.600752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.644123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 815/1626] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/users => generated 308 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:53.645345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.686167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:53.687870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:53.738960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72062a60-2dd6-4b2b-b406-5f803531b85e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.753875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.756476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.757313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.757622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.787496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.789600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.806341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 816/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:53.807084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.829781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646ece-4066-4e81-ad1e-58c2c6ffe77a service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.832965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 812/1628] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 17 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:53.841908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.850184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:53.955868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.955868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.955868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.955868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.957971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.957971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:53.958232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869305b4-548c-4bcf-95ac-d50f0cf03070 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.958232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.958232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.958232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.958534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.958606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 817/1629] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:53.958606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:53.958606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93c33-c344-49bd-adb2-6a2c550f2ab6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:53.958606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:53.958884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:53.958884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:53.958884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] PATH_INFO: `/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3/users/fd1105b8474a483f8827d9230af2f997/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:53.992519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.993388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64f00af7c2438aa44e74dbf3abc5c3, user_id=fd1105b8474a483f8827d9230af2f997, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:53.997458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.004573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.017675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 813/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:54.029125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:54.038014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 818/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:53 2022] PUT /identity/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3/users/fd1105b8474a483f8827d9230af2f997/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:54.041726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:54.054217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592b5ea-4c5b-41ce-b042-6a8e26eca378 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:54.172636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:54.173734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:54.175407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:54.177145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:54.180652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9d43a-f7de-4543-ac2e-5f3a73e9b599 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:54.194785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:54.195419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:54.195693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:54.196356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:54.198212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:54.201124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.226798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 819/1632] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:21:54.230526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:54.251186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca19c-38c0-4fd5-bcb0-6fa4e255ff64 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:54.264781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:54.266368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:54.266368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:54.266368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] PATH_INFO: `/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3/users/fd1105b8474a483f8827d9230af2f997/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:54.277521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64f00af7c2438aa44e74dbf3abc5c3, user_id=fd1105b8474a483f8827d9230af2f997, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:54.280353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d1955-1669-4963-b437-c4a7a2a9cbe2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.306044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 820/1633] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:54 2022] PUT /identity/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3/users/fd1105b8474a483f8827d9230af2f997/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:54.310896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:54.312409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.315447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:54.316986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:54.316986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:54.339190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 814/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:54.393918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] MFA Rules not processed for user `fd1105b8474a483f8827d9230af2f997`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:54.395580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:54.439990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:54.551005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 821/1635] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:54 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:21:54.559206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:54.569541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889220af-099a-468f-b003-38d453d1f581 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:54.662142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:54.663036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:54.663322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:54.663592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:54.675772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:54.677534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6263b4e-3c23-4f59-baae-c6b254f4cc29 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:54.681920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:54.689904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 815/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:54 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:55.123044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:55.262046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09c2d7-e734-4d16-968b-8b957a8b3c23 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:55.267551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:55.268358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.268714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.269040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] PATH_INFO: `/v3/users/7f72ad3badd74c7b98d650c76f6da43f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.270760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f72ad3badd74c7b98d650c76f6da43f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:55.272927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:55.272927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Aug 17 11:21:55.272927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: Aug 17 11:21:55.274287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:55.339354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5b23-460a-4e54-a1f9-51b376a2db90 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.339808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5b23-460a-4e54-a1f9-51b376a2db90 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.339908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5b23-460a-4e54-a1f9-51b376a2db90 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.341441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 816/1637] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 17 11:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:21:55.356334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9af03-d1d3-47a6-84ec-4aebf4269780 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.356671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9af03-d1d3-47a6-84ec-4aebf4269780 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.356862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9af03-d1d3-47a6-84ec-4aebf4269780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.395272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-36f9af03-d1d3-47a6-84ec-4aebf4269780 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:55.398523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36f9af03-d1d3-47a6-84ec-4aebf4269780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:55.416532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f72ad3badd74c7b98d650c76f6da43f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:55.417414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f72ad3badd74c7b98d650c76f6da43f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:55.418020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f72ad3badd74c7b98d650c76f6da43f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:55.437172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f72ad3badd74c7b98d650c76f6da43f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:55.501581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-093c4145-db0b-40af-bf1b-6e438f5c6347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f72ad3badd74c7b98d650c76f6da43f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:55.526576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 822/1638] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:21:55 2022] DELETE /identity/v3/users/7f72ad3badd74c7b98d650c76f6da43f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:55.532094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.532528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.532945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.583976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 817/1639] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 17 11:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:55.591625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093362b3-7d06-4224-9bd0-cf05bd0490ba None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.591908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093362b3-7d06-4224-9bd0-cf05bd0490ba None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.592213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093362b3-7d06-4224-9bd0-cf05bd0490ba None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.593498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:55.593645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 818/1640] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 17 11:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 11:21:55.595294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:55.600919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.601264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.601476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.643327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:55.645227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:55.646198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:55.701029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 823/1641] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:21:55.748288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 819/1642] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:21:55.758711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:55.760862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:55.775243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:55.777096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:55.858133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d35a7b-f6f5-4cc6-a894-b3620e89c107 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:55.865944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:55.866679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.866962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.867237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.883061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:55.885099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e0915-3e64-4bf3-82f3-057764f49796 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:55.904124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 820/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:21:55.929449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9e447-2dbe-491e-85a1-fbbaadcf5db2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:55.937047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:55.937696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:55.938004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:55.938235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:55.962146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:55.963191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2500db-4a3e-4fe4-9746-877c9f0dc93b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:55.984747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 824/1644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:56.135452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:56.136016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:56.136953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:56.139495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 821/1645] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 17 11:21:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:21:56.147744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:56.148151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:56.148430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:56.182722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:56.184326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:56.205701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 825/1646] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:56.213173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:56.214886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:56.247768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802a2c6-84fc-4bba-885d-6e19caf8568f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:56.255961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:56.258654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:56.258967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:56.259241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:56.294442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:56.296000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76ce1-1287-4552-9359-3f6889f8215c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:56.324011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 822/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:56.605633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:56.607071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:56.637267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe32a5-e30e-4ef4-87da-ba3c92ef0d44 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:56.642391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:56.643240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:56.643647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:56.643937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] PATH_INFO: `/v3/users/9f85bd65761a4a93a233310e9d996bba` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:56.645191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f85bd65761a4a93a233310e9d996bba)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:56.648524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:56.752512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f85bd65761a4a93a233310e9d996bba'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:56.753558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f85bd65761a4a93a233310e9d996bba'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:56.764478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f85bd65761a4a93a233310e9d996bba'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:56.774044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f85bd65761a4a93a233310e9d996bba'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:56.802576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f85bd65761a4a93a233310e9d996bba'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:56.822648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 826/1648] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:21:56 2022] DELETE /identity/v3/users/9f85bd65761a4a93a233310e9d996bba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:56.827293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c364-0b1f-4c4c-b79e-d2023797e34b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:56.827825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c364-0b1f-4c4c-b79e-d2023797e34b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:56.827825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0c364-0b1f-4c4c-b79e-d2023797e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:56.877143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d0a0c364-0b1f-4c4c-b79e-d2023797e34b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:56.878889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0a0c364-0b1f-4c4c-b79e-d2023797e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:56.886601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:56.972793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 823/1649] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:56.991000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:56.992532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:57.149369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:57.166717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca23366-5dc4-4b2c-973e-efe687197ae3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:57.179450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:57.181537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:57.182121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:57.182121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:57.203929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:57.206732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:57.238427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 827/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:21:57.633243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:57.633694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:57.634188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:57.692935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] MFA Rules not processed for user `83e1f7d7b47043948007165732eb0b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:57.696850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:57.871045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 824/1651] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:57.872278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:57.873731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:57.900338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffd696-2878-48a2-a566-ec6919c3a71d service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:57.919538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:57.920264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:57.920558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:57.920831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:57.921478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:57.923458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.000553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 828/1652] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:21:57 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:58.002494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.019436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba45e5-e496-4286-94a0-e25d97070e94 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.170062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.170950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.172939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.172939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.175514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.185495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.251061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 825/1653] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:21:58 2022] POST /identity/v3/users => generated 308 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:21:58.255036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.282064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d00674-a546-4209-a2be-beb92272aaa8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.296428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.297084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.298508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.298790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.301889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.305321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.340094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 829/1654] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:58.344706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.369348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493582f0-d875-4462-8b18-16ca40e5b007 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.391136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.395605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.396021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.396402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] PATH_INFO: `/v3/projects/837442e5fe8148ab869711931bb7948c/users/f23143d5537647e1a4131ac34a6013c3/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.460766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837442e5fe8148ab869711931bb7948c, user_id=f23143d5537647e1a4131ac34a6013c3, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.465294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.523999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 826/1655] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:58 2022] PUT /identity/v3/projects/837442e5fe8148ab869711931bb7948c/users/f23143d5537647e1a4131ac34a6013c3/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:58.527431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.540333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eeb98-c0ec-4a64-8a50-1d818743738d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.633756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.637289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:58.649512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:58.662048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.665293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.665781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.667172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.676791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.678471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.693746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 830/1656] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:21:58.698505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:58.722009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715286-5b7d-4436-90cd-7891e8034c20 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.768493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.769193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.769478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.769754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] PATH_INFO: `/v3/projects/837442e5fe8148ab869711931bb7948c/users/f23143d5537647e1a4131ac34a6013c3/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.778236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837442e5fe8148ab869711931bb7948c, user_id=f23143d5537647e1a4131ac34a6013c3, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.785535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.790229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6eb16-ad15-4111-ba32-32ea8ae47a81 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:58.796295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:58.796895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:58.797179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:58.797454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] PATH_INFO: `/v3/projects/06a2d962d36f436cb4ca66767f58f82d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:58.798767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a2d962d36f436cb4ca66767f58f82d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:58.799967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 11:21:58.799967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Aug 17 11:21:58.799967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: Aug 17 11:21:58.807758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:58.827705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 831/1657] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:21:58 2022] PUT /identity/v3/projects/837442e5fe8148ab869711931bb7948c/users/f23143d5537647e1a4131ac34a6013c3/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:58.915167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a2d962d36f436cb4ca66767f58f82d', 'request_id': 'req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:58.934554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a2d962d36f436cb4ca66767f58f82d', 'request_id': 'req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:58.958393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a2d962d36f436cb4ca66767f58f82d', 'request_id': 'req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:58.994695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] The token cache is being invalidate because project 06a2d962d36f436cb4ca66767f58f82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:21:58.995378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:58.996485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.000840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 827/1658] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:21:58 2022] DELETE /identity/v3/projects/06a2d962d36f436cb4ca66767f58f82d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:59.004879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:59.006963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:59.142769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b38-d689-4cdb-ac47-adb7354d9be8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:59.230856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:21:59.264757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:59.265439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:59.265848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:59.265994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] PATH_INFO: `/v3/users/fd1105b8474a483f8827d9230af2f997` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:59.267442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1105b8474a483f8827d9230af2f997)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:59.269627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:59.277775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:59.279435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:59.315292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71b14f-e7e8-4eef-bf42-f4a729f72a39 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:59.336788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:59.338652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:59.338942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:59.339218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] PATH_INFO: `/v3/projects/bf2e5982630141ddb3a875791ec8848c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:59.347689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2e5982630141ddb3a875791ec8848c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:21:59.356218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:21:59.363269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1105b8474a483f8827d9230af2f997'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.364497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1105b8474a483f8827d9230af2f997'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.365540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1105b8474a483f8827d9230af2f997'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.383220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1105b8474a483f8827d9230af2f997'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.415350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9bb4a9be-3a31-4a88-9927-69583f2c1cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1105b8474a483f8827d9230af2f997'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.441218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 832/1659] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:21:59 2022] DELETE /identity/v3/users/fd1105b8474a483f8827d9230af2f997 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:21:59.487410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2e5982630141ddb3a875791ec8848c', 'request_id': 'req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.506749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2e5982630141ddb3a875791ec8848c', 'request_id': 'req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.518559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2e5982630141ddb3a875791ec8848c', 'request_id': 'req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.551296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] The token cache is being invalidate because project bf2e5982630141ddb3a875791ec8848c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:21:59.552024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.556110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c24bfc8f-0426-4f0a-9325-f6dc0e81eb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:21:59.566743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 828/1660] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:21:59 2022] DELETE /identity/v3/projects/bf2e5982630141ddb3a875791ec8848c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:21:59.568539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:59.569012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:59.569434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:59.630185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:59.632581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:59.817660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:59.818062 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:59.818247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:59.819069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 833/1661] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:21:59.917317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:21:59.921683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:21:59.960707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 829/1662] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:21:59.965023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:21:59.982453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0801c42-b453-4165-aa17-b96be91a1dc4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:21:59.997098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:21:59.997757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:21:59.998039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:21:59.998312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:21:59.999782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:00.000564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.004963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.042151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 834/1663] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:00.046513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:00.072199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd6fcb-dae5-49b0-afdf-6e22edeac6bf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:00.088891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:00.090709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.092383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.092946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.093854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.101874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.158515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:00.230151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 830/1664] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:00 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:00.242711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:00.265923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0d7c-de50-4d14-b887-81125968f556 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:00.412530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:00.441746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:00.442726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.443315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.443907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.444878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.447611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.524143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 835/1665] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:00 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:00.528172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:00.542221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7452779-44ff-4165-8c0e-0354e2da2523 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:00.556258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:00.556975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.557250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.557560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.558224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.559856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.594302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 831/1666] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:00.598182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:00.616857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c2ac4-35f4-4477-9459-dd71409e228d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:00.629989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:00.630781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.631123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.631502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.632305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.633962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d4d1f-816e-4849-a4d1-c4dcc5748eeb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.673015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 836/1667] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:00.677955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:00.694774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad57759-0331-4e64-a60b-ed2c9f29d800 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:00.707284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:00.708193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.708540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.708874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] PATH_INFO: `/v3/projects/08c90b1ee52c421683ee54efeb8d37f9/users/dc82a1e39f63441fab7e8fa2c181618b/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.765828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c90b1ee52c421683ee54efeb8d37f9, user_id=dc82a1e39f63441fab7e8fa2c181618b, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:00.771639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:00.803656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 832/1668] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:00 2022] PUT /identity/v3/projects/08c90b1ee52c421683ee54efeb8d37f9/users/dc82a1e39f63441fab7e8fa2c181618b/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:00.814045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:00.814325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:00.814702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:00.858654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] MFA Rules not processed for user `dc82a1e39f63441fab7e8fa2c181618b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:00.859986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:00.942626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 837/1669] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:00.944462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.108636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92651e6-ec54-4f33-a7f3-050fb2840d84 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.115144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.115840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.116153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.116434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.117154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.119349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.180357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 833/1670] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:00 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:01.181884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.201382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0a7e4-3155-4e55-aeb3-ac6e2c512769 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.378647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.379314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.379590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.380364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.381222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.387731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.445537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 838/1671] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:01 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:01.448999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.466480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f571a-508a-4af9-a94f-004f2b0e00b8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.478810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.480221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.480700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.481071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.481771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.483822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.500772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 834/1672] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:01.505377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.519647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344cbd-9db0-4e13-af7c-75810a8ecfeb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.529575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.530500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.530938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.531354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] PATH_INFO: `/v3/projects/26266e9b2cf340b3a2b4494c1649e36c/users/cd97ab8b8a8d473f849e3955ab44e4cd/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.571043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26266e9b2cf340b3a2b4494c1649e36c, user_id=cd97ab8b8a8d473f849e3955ab44e4cd, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.579865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.620258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 839/1673] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:01 2022] PUT /identity/v3/projects/26266e9b2cf340b3a2b4494c1649e36c/users/cd97ab8b8a8d473f849e3955ab44e4cd/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:01.621483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.636625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc98921-52d3-4494-ac01-c6a7744cf84d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.725649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.726282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.726556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.726824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.727647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.729482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ebe2c-922c-4fa9-a28b-c8d375070fd6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.746072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 835/1674] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:01.750177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:01.763394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefe0ab-9a19-449b-9cb2-38f63e9e4ff0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:01.769425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:01.770566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.771035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.771490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] PATH_INFO: `/v3/projects/26266e9b2cf340b3a2b4494c1649e36c/users/cd97ab8b8a8d473f849e3955ab44e4cd/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.773722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26266e9b2cf340b3a2b4494c1649e36c, user_id=cd97ab8b8a8d473f849e3955ab44e4cd, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:01.776799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:01.802961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 840/1675] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:01 2022] PUT /identity/v3/projects/26266e9b2cf340b3a2b4494c1649e36c/users/cd97ab8b8a8d473f849e3955ab44e4cd/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:01.814586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:01.815560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:01.815838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:01.876538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] MFA Rules not processed for user `cd97ab8b8a8d473f849e3955ab44e4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:01.880330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:01.918821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:02.023408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 836/1676] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:02.036751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:02.038819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:02.063720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:02.167541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590559b3-f421-4887-8e74-b474049eb41e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:02.176192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:02.177140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:02.177579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:02.178029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:02.196771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:02.198976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78843fa3-ac02-4bc6-b88b-08de5f94d818 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:02.236217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 841/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:02.333926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:02.528520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36417a17-39e0-40f2-87a2-ef87c643d43d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:02.555348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:02.556563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:02.557276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:02.557890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] PATH_INFO: `/v3/users/dc82a1e39f63441fab7e8fa2c181618b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:02.559366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc82a1e39f63441fab7e8fa2c181618b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:02.562165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:02.645541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc82a1e39f63441fab7e8fa2c181618b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:02.660346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc82a1e39f63441fab7e8fa2c181618b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:02.661284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc82a1e39f63441fab7e8fa2c181618b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:02.675963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc82a1e39f63441fab7e8fa2c181618b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:02.708659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc82a1e39f63441fab7e8fa2c181618b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:02.729328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:02.729587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 837/1678] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:02 2022] DELETE /identity/v3/users/dc82a1e39f63441fab7e8fa2c181618b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:02.730158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:02.730437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:02.775257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:02.776666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:02.903148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 842/1679] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:02.919718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:02.922777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:02.940447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:02.942900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:02.980956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a1f05-e8b9-44ea-b02b-fff7e3c72019 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:02.988964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:03.002399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.003385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.003670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.003970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] PATH_INFO: `/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.005558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64f00af7c2438aa44e74dbf3abc5c3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.008570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.033366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc35c0-4552-466b-ab88-dd57b27145ba admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:03.038492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.039346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.039764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.040254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.053545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.055338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad305-11d8-4bc9-bfcb-2d206c5c3ed9 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.075828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 838/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:03.097118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64f00af7c2438aa44e74dbf3abc5c3', 'request_id': 'req-3c2f20d1-4871-40b8-bfde-70fa77037b57'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:03.110406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64f00af7c2438aa44e74dbf3abc5c3', 'request_id': 'req-3c2f20d1-4871-40b8-bfde-70fa77037b57'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:03.119646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64f00af7c2438aa44e74dbf3abc5c3', 'request_id': 'req-3c2f20d1-4871-40b8-bfde-70fa77037b57'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:03.134749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] The token cache is being invalidate because project ea64f00af7c2438aa44e74dbf3abc5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:03.135278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:03.136864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c2f20d1-4871-40b8-bfde-70fa77037b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:03.147386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.147847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.148418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.153533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 843/1681] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:02 2022] DELETE /identity/v3/projects/ea64f00af7c2438aa44e74dbf3abc5c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:03.179162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:03.180939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:03.298969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.298969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.299523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.305187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 839/1682] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:03.341055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:03.342968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:03.363303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:03.367879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 844/1683] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:03.385347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e50ba-e543-448e-9e89-9ff0a86bb9fb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:03.393940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.394585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.394901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.395267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.396068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:03.396373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.399396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.422981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 840/1684] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:03.426924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:03.453813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90f31-d792-4adc-93ed-f2eb8462082b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:03.460893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.461527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.461805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.462077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.462770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.465665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cf010-997d-479f-80f4-72f343758b50 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.534050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 845/1685] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:03.538782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:03.559789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70636e3-5e9c-4dbb-9226-e506ebc40fa3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:03.663235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.663647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.663948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.664239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.664874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.666802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.682375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.683221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.684070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.703290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 841/1686] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:03.723903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:03.734628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:03.765166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] MFA Rules not processed for user `f23143d5537647e1a4131ac34a6013c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:03.769110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:03.770429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab968e1-c739-4d6e-b3cd-7bd261c664d1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:03.797019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:03.797664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.798104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.798387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.799088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:03.803628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16ae0c-6380-4b87-a120-0a5185dde56e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:03.851963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 842/1687] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:03.853487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae74b-16be-42c8-b070-b00846d2c12a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:03.853739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae74b-16be-42c8-b070-b00846d2c12a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:03.854058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae74b-16be-42c8-b070-b00846d2c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:03.926289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-156ae74b-16be-42c8-b070-b00846d2c12a None None] MFA Rules not processed for user `652575a6004a45db9b7db7a9a36aca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:03.928603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-156ae74b-16be-42c8-b070-b00846d2c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:03.966271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 846/1688] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:03.968188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.003480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0083946-958b-463c-8208-d2f68e1b36f2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.013740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:04.023469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.025292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.025701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.026076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.026882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.036359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.065621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 847/1689] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:04.068478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.090941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b11f32-08db-4e35-b1ad-47730ed8df97 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.108306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.109113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.109759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.110135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] PATH_INFO: `/v3/projects/a8d83e9950ef4a99b913d0f4a90df468/users/4a88d80fceb948f7b7cfe4d16d943b4f/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.120500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 843/1690] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:04.131154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d83e9950ef4a99b913d0f4a90df468, user_id=4a88d80fceb948f7b7cfe4d16d943b4f, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.132307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.132624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.132914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.135140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07389633-bdc8-4593-9fa0-b3bc2ef99428 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.162267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] MFA Rules not processed for user `652575a6004a45db9b7db7a9a36aca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:04.162562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 848/1691] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:04 2022] PUT /identity/v3/projects/a8d83e9950ef4a99b913d0f4a90df468/users/4a88d80fceb948f7b7cfe4d16d943b4f/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:04.174783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.175065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.175386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.176227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.240907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] MFA Rules not processed for user `4a88d80fceb948f7b7cfe4d16d943b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:04.242162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.308830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 844/1692] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:04.309707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.311072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.406221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 849/1693] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:04.407204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.409308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.495739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527fa4-7b60-4fc7-9423-3dc5617504da None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.513379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:04.521933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.522828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.522934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.523297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] PATH_INFO: `/v3/projects/08c90b1ee52c421683ee54efeb8d37f9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.525764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c90b1ee52c421683ee54efeb8d37f9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.527803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.545044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d75e2f-5ae1-4db8-a6c6-28a495c9fe20 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.552789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.553473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.553950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.554227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.580709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.584990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.613168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 850/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:04.617350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.640132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ece0-5f1a-40cf-acdf-267bbc3bd9b9 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.645649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.646405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.646729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.647012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.648013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.650093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.687243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c90b1ee52c421683ee54efeb8d37f9', 'request_id': 'req-cb813212-1d92-4611-9d3b-f8698e463708'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:04.699248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 851/1695] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:04 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:04.703259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.703888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c90b1ee52c421683ee54efeb8d37f9', 'request_id': 'req-cb813212-1d92-4611-9d3b-f8698e463708'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:04.718936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c90b1ee52c421683ee54efeb8d37f9', 'request_id': 'req-cb813212-1d92-4611-9d3b-f8698e463708'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:04.746061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] The token cache is being invalidate because project 08c90b1ee52c421683ee54efeb8d37f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:04.746358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:04.747706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:04.750545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 845/1696] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:04 2022] DELETE /identity/v3/projects/08c90b1ee52c421683ee54efeb8d37f9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:04.755154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.760747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.772680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:04.876053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1d7-d45d-47bc-a5d6-6b87c7c969ff admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.898207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.898853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.899129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.899400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.900065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.906383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813212-1d92-4611-9d3b-f8698e463708 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:04.906669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.923247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:04.924487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:04.924593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:04.924820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] PATH_INFO: `/v3/users/cd97ab8b8a8d473f849e3955ab44e4cd` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:04.928207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd97ab8b8a8d473f849e3955ab44e4cd)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:04.928909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:04.961869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 852/1697] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:04 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:04.966220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:04.968720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:04.993529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2b56e-bb18-4d69-b457-543f37957dfe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:05.001340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:05.003568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.004081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.004687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.005660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:05.010917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:05.028939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 853/1698] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:05.033332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:05.045598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd97ab8b8a8d473f849e3955ab44e4cd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:05.046291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399a76-3308-4b92-a3d8-c0843db4b596 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:05.054039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:05.055414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.055910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.056543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] PATH_INFO: `/v3/projects/ade32f9ef86642f896717f465dd1a188/users/dff5d7ab2d2f4fbeb41ab40614332557/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.056658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd97ab8b8a8d473f849e3955ab44e4cd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:05.057321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd97ab8b8a8d473f849e3955ab44e4cd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:05.070332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd97ab8b8a8d473f849e3955ab44e4cd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:05.095164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade32f9ef86642f896717f465dd1a188, user_id=dff5d7ab2d2f4fbeb41ab40614332557, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:05.105347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd97ab8b8a8d473f849e3955ab44e4cd'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:05.110899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:05.131577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 846/1699] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:04 2022] DELETE /identity/v3/users/cd97ab8b8a8d473f849e3955ab44e4cd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:05.150802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 854/1700] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:05 2022] PUT /identity/v3/projects/ade32f9ef86642f896717f465dd1a188/users/dff5d7ab2d2f4fbeb41ab40614332557/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:05.154936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:05.156535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:05.242246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbcd6b-7727-4c4f-ba7a-0b0c976b6725 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:05.294894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:05.337483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:05.338316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.338671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.339072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.341343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:05.343092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89961727-f199-4705-98c3-be5a85e7fa36 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:05.360813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 847/1701] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:05.361612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:05.376239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e256a-13e9-430e-8b22-a48f47127220 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:05.388898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:05.389588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.390000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.390274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] PATH_INFO: `/v3/projects/ade32f9ef86642f896717f465dd1a188/users/dff5d7ab2d2f4fbeb41ab40614332557/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.393387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade32f9ef86642f896717f465dd1a188, user_id=dff5d7ab2d2f4fbeb41ab40614332557, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:05.399550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:05.437843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 855/1702] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:05 2022] PUT /identity/v3/projects/ade32f9ef86642f896717f465dd1a188/users/dff5d7ab2d2f4fbeb41ab40614332557/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:05.440186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.440794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.441272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.489409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] MFA Rules not processed for user `dff5d7ab2d2f4fbeb41ab40614332557`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:05.491120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:05.720868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 848/1703] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:05.732596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:05.734530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:05.894257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233f502-31b0-4f21-94c7-d1711834e439 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:05.906264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:05.906896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:05.907166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:05.907437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:05.929218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:05.930669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:05.934982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:05.951397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 856/1704] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:06.122218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:06.134435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19402b-f7eb-4309-87f3-a44c5909e077 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:06.146134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:06.147124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:06.147124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:06.147310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:06.149212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:06.276954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:06.278896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5e49-29b6-48a8-a3a2-baa8d634255e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:06.308922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 849/1705] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:06.838824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:06.840424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:06.991130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e17aa6-f0f2-42c1-b0c9-e49504b8d623 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:06.997343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:06.998004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:06.998278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:06.998548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] PATH_INFO: `/v3/projects/26266e9b2cf340b3a2b4494c1649e36c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.004941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26266e9b2cf340b3a2b4494c1649e36c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:07.008956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:07.138090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0cc56-d99c-498e-a530-9357eeae346c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.138650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0cc56-d99c-498e-a530-9357eeae346c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.138650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0cc56-d99c-498e-a530-9357eeae346c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.139980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 850/1706] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 17 11:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:07.145644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddb65-51e3-4607-ac2b-56bf34d997a9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.146169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddb65-51e3-4607-ac2b-56bf34d997a9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.146584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ddb65-51e3-4607-ac2b-56bf34d997a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.152146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26266e9b2cf340b3a2b4494c1649e36c', 'request_id': 'req-778a7938-c65c-4fe7-aade-96d2109a2438'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:07.168367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26266e9b2cf340b3a2b4494c1649e36c', 'request_id': 'req-778a7938-c65c-4fe7-aade-96d2109a2438'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:07.196044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26266e9b2cf340b3a2b4494c1649e36c', 'request_id': 'req-778a7938-c65c-4fe7-aade-96d2109a2438'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:07.224280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] The token cache is being invalidate because project 26266e9b2cf340b3a2b4494c1649e36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:07.224595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:07.225241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-778a7938-c65c-4fe7-aade-96d2109a2438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:07.232528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 857/1707] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:06 2022] DELETE /identity/v3/projects/26266e9b2cf340b3a2b4494c1649e36c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:07.234094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da5aa-b8e3-4051-9e27-7c77e5a29c38 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.234475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da5aa-b8e3-4051-9e27-7c77e5a29c38 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.234790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784da5aa-b8e3-4051-9e27-7c77e5a29c38 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.236764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 858/1708] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:07.237838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.238118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.238386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.259525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:07.260768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.278083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-959ddb65-51e3-4607-ac2b-56bf34d997a9 None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:07.279567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-959ddb65-51e3-4607-ac2b-56bf34d997a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.321261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:07.348731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 851/1709] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:07.351187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.351706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.352336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.389495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:07.391500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.393556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 859/1710] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:07.401856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:07.404956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.435691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca2c2-6d6c-4705-bf5f-708facadc6cf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:07.444924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:07.445769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.446050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.446479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.461471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:07.463714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3c4ed-58f7-48e0-9421-dd71ed7c8198 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:07.483128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 860/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:07.486840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.488842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.489489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.529229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 852/1712] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:07.556588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:07.560658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.588243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 861/1713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:07.592815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:07.629885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84eef4-688f-4ee3-b640-042113b21111 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:07.643389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:07.644804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.645684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.646121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.646934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:07.647384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:07.650172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920064-826a-4f26-92bc-5e7521170212 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:07.696423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 853/1714] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:07.698698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:07.723796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51d62-5a57-4403-a780-4770cd026772 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:07.758964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde50e2-0a2e-4fbf-8a0c-e2523c18e1e4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.759387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde50e2-0a2e-4fbf-8a0c-e2523c18e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.759752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde50e2-0a2e-4fbf-8a0c-e2523c18e1e4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.765207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 854/1715] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 17 11:22:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:07.779775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.780343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.780988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.787257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:07.789668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:07.790404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:07.792586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:07.793901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:07.804051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:07.826442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:07.859410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:07.860849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:07.864720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 862/1716] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:07.868827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:08.075333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10695c-1f93-4ce4-8e15-d5f62319bd01 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:08.090319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:08.092334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.093296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.093622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.094922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:08.101756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:08.106580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 855/1717] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:08.117337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:08.144637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f235cc-a8b7-4b73-bb5a-9eb9dea13385 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:08.168188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:08.168712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.168991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.169260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.175286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 863/1718] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:07 2022] POST /identity/v3/users => generated 292 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:08.181095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:08.220572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58885-0c99-4c58-90b3-8e3e9504d275 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:08.226057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:08.227629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.227956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.228225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.228882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:08.231638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:08.233289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:08.235118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:08.255897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 864/1719] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:08.260547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:08.275473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 856/1720] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:08.314892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23283cfd-d3d9-40a9-aacb-e290cf146121 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:08.365344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:08.370986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.371285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.371568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.372923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:08.379218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855338ef-8c99-4d78-8991-7255b255a5c0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:08.463122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 865/1721] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:08.466929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:08.499109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa1c3-db48-4277-8167-dfac35833c94 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:08.535306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:08.536085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.536309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.536582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] PATH_INFO: `/v3/projects/8a0bf7e1302a4b99b7583ed965f4a2d9/users/08b61a52c1ec44f7ac4deab6ea1ebca6/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.602130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0bf7e1302a4b99b7583ed965f4a2d9, user_id=08b61a52c1ec44f7ac4deab6ea1ebca6, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:08.604937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:08.653133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 857/1722] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:08 2022] PUT /identity/v3/projects/8a0bf7e1302a4b99b7583ed965f4a2d9/users/08b61a52c1ec44f7ac4deab6ea1ebca6/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:08.655626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:08.656028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:08.656199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:08.796732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] MFA Rules not processed for user `08b61a52c1ec44f7ac4deab6ea1ebca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:08.820329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:09.028847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 866/1723] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:09.032932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.091385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:09.156538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf0411-6822-4017-81d7-05b368157a3c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.172601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.173448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.173732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.174004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.174664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.176676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:09.241472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.243372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 858/1724] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:09 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:09.260140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec2af5-4a75-435c-805f-b5be91d34214 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.364764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:09.405503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.406414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.406788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.407045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.407885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.410221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:09.462000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 867/1725] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:09 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:09.466013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.485442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43a20a-98e7-4d3d-bdfe-ee0394e395c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.500714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.501461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.501906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.502327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.503455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.505324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:09.525121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 859/1726] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:09.529625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.545651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b59-4edb-4af6-85da-9976b51c7cb9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.559075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.560083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.560576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.561017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] PATH_INFO: `/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167/users/1ace107ddfce46d58747bd75dc81fe46/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.632184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b6ffe9b6b64d8aadc58de0e77fd167, user_id=1ace107ddfce46d58747bd75dc81fe46, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.657043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:09.706041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 868/1727] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:09 2022] PUT /identity/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167/users/1ace107ddfce46d58747bd75dc81fe46/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:09.713629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.728184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641772fc-d21a-4369-be2f-e0c36a795abc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.827485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.828445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.829022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.829494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.831470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.833710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9ef9-d477-4c7f-9439-f0b879ba95d2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:09.862385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 860/1728] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:09.868558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:09.911971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41a38-f0e7-4a4e-8392-8722192b974f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:09.942004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:09.942883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:09.942965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:09.943238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] PATH_INFO: `/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167/users/1ace107ddfce46d58747bd75dc81fe46/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:09.959631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b6ffe9b6b64d8aadc58de0e77fd167, user_id=1ace107ddfce46d58747bd75dc81fe46, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:09.971216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:10.036451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 869/1729] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:09 2022] PUT /identity/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167/users/1ace107ddfce46d58747bd75dc81fe46/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:10.056644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:10.056950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:10.057222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:10.062893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:10.197136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] MFA Rules not processed for user `1ace107ddfce46d58747bd75dc81fe46`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:10.202953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:10.417059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be39eb4-9bee-4444-b367-fb086b8b03e7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:10.433203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:10.434619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:10.434619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:10.434818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:10.454333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:10.478010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 861/1730] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:10.496717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:10.499016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:10.504016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:10.506111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:10.542839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 870/1731] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:10.597416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:10.778876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8f22-e619-4384-80ff-ee0b474efd4a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:10.784010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:10.784757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:10.785038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:10.785308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:10.821667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:10.823227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:10.865943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 862/1732] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:10.981786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:10.983644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:11.147757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:11.156952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f811b-9ec2-432a-bee1-457c27424be2 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:11.165843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:11.168970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:11.169470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:11.169924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:11.172871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f4413-ce93-4e74-bc4c-a7fbc0001d52 service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:11.182969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:11.184125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:11.184540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:11.184812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] PATH_INFO: `/v3/users/83e1f7d7b47043948007165732eb0b5c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:11.189020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e1f7d7b47043948007165732eb0b5c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:11.193554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:11.274976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:11.316685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:11.320648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e1f7d7b47043948007165732eb0b5c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:11.321399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e1f7d7b47043948007165732eb0b5c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:11.323123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e1f7d7b47043948007165732eb0b5c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:11.325285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd9a01-a764-4d4a-bac3-c44cd70ff4bf service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:11.351539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 863/1733] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:11.353130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:11.355853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:11.356421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:11.357619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e1f7d7b47043948007165732eb0b5c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:11.403123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e1f7d7b47043948007165732eb0b5c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:11.451627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 871/1734] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:10 2022] DELETE /identity/v3/users/83e1f7d7b47043948007165732eb0b5c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:11.462662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] MFA Rules not processed for user `83cdff24514c42679e46d8f5b7c27fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:11.464128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:11.652454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:11.654347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:11.664270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 864/1735] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:11.909742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de236fcf-1161-42ce-ae30-3d992f012e93 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:11.962516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:11.964285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:11.969093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:11.969580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:12.034272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:12.039224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:12.072126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 872/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:12.425384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:12.427855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:12.607707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:12.630929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067b2a2-0151-462e-8293-aaf4a25f7154 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:12.648339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:12.649364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:12.649653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:12.649950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] PATH_INFO: `/v3/projects/2645ed72247c45eea508904193a0780e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:12.651355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2645ed72247c45eea508904193a0780e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:12.653670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:12.740867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:12.742689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:12.770489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2645ed72247c45eea508904193a0780e', 'request_id': 'req-0059862d-6b36-4705-b572-c16ad8ea89e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:12.785795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2645ed72247c45eea508904193a0780e', 'request_id': 'req-0059862d-6b36-4705-b572-c16ad8ea89e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:12.798518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2645ed72247c45eea508904193a0780e', 'request_id': 'req-0059862d-6b36-4705-b572-c16ad8ea89e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:12.801181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b849e-eead-4dc8-bfaa-7e653c77b7b7 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:12.843870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] The token cache is being invalidate because project 2645ed72247c45eea508904193a0780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:12.844281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:12.846814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:12.855179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 865/1737] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:12 2022] DELETE /identity/v3/projects/2645ed72247c45eea508904193a0780e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:12.857542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:12.862969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:13.088667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:13.089719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:13.093816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:13.094295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] PATH_INFO: `/v3/users/08b61a52c1ec44f7ac4deab6ea1ebca6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:13.099627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b61a52c1ec44f7ac4deab6ea1ebca6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:13.108304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:13.155981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059862d-6b36-4705-b572-c16ad8ea89e9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:13.169833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:13.172880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:13.173335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:13.173654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] PATH_INFO: `/v3/users/f23143d5537647e1a4131ac34a6013c3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:13.179807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23143d5537647e1a4131ac34a6013c3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:13.181911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:13.249797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:13.333781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b61a52c1ec44f7ac4deab6ea1ebca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.339014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b61a52c1ec44f7ac4deab6ea1ebca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.346450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b61a52c1ec44f7ac4deab6ea1ebca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.391587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23143d5537647e1a4131ac34a6013c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.393050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b61a52c1ec44f7ac4deab6ea1ebca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.409194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23143d5537647e1a4131ac34a6013c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.409958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23143d5537647e1a4131ac34a6013c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.428584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23143d5537647e1a4131ac34a6013c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.458585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2497278-5f06-4900-8f32-bdaf4c93e5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23143d5537647e1a4131ac34a6013c3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.460186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-05d726dc-056a-4731-80af-7d2a85361a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b61a52c1ec44f7ac4deab6ea1ebca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:13.488153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 866/1738] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:12 2022] DELETE /identity/v3/users/f23143d5537647e1a4131ac34a6013c3 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:13.499288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:13.500820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:13.501366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:13.505771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 873/1739] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:12 2022] DELETE /identity/v3/users/08b61a52c1ec44f7ac4deab6ea1ebca6 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:13.510602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:13.510892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:13.512509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:13.553868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:13.569863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:13.571109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:13.633892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] MFA Rules not processed for user `9c06d5a51e984f36879bbb86b6d60513`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:13.641003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:13.811430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 874/1740] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:13.850420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 867/1741] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:13.861036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:13.862899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:13.872271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:13.877292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:13.991267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19aae3-d574-443b-96e2-ed620a8fc752 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.000111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.001634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.005074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.005554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.028935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.030673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04bdf5-bf19-47ff-9719-093b56fc52a8 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.051156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 875/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:14.054131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.055393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.055844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.081124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026517ef-8e14-44eb-883e-6f5d134337b1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.093033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.093930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.094288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.094879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.106647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.108699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b069-1413-41cc-a758-4c202f55ba8b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.112051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] MFA Rules not processed for user `fc564035b8ee4029a9caced9064f69cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:14.113575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.121361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 868/1743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:14.169335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:14.222091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 876/1744] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:14.233327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.233657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.233812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.275509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] MFA Rules not processed for user `fc564035b8ee4029a9caced9064f69cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:14.276990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.298411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 869/1745] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:14.315579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:14.317531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.354446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129d05-5020-46e5-87f7-db18b88d2a52 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.365397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.366560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.367364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.367888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.389364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.390461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:14.391564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073321-8579-4011-82ee-de652fb5c154 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.392310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.407946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 877/1746] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:14.419231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8faa0-27d7-4752-a52a-68df51bb9ca2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.434483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.435168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.435442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.435708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] PATH_INFO: `/v3/projects/837442e5fe8148ab869711931bb7948c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.436996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837442e5fe8148ab869711931bb7948c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.439451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.550370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837442e5fe8148ab869711931bb7948c', 'request_id': 'req-79db3161-f504-467b-a6c8-429cde410d65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:14.562659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837442e5fe8148ab869711931bb7948c', 'request_id': 'req-79db3161-f504-467b-a6c8-429cde410d65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:14.578325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837442e5fe8148ab869711931bb7948c', 'request_id': 'req-79db3161-f504-467b-a6c8-429cde410d65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:14.588291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:14.599041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] The token cache is being invalidate because project 837442e5fe8148ab869711931bb7948c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:14.599337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:14.600221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79db3161-f504-467b-a6c8-429cde410d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:14.607020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 870/1747] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:14 2022] DELETE /identity/v3/projects/837442e5fe8148ab869711931bb7948c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:14.608893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.609277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.609646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.656275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:14.660078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.772780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 878/1748] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:14.780198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.780481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.780777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.804081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:14.805569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:14.819486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:14.820567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 871/1749] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:14.830517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87379e6-86bc-4f98-a1ec-c9a61fb883e5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.835535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.836390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.836798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.837199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.837984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:14.838488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.840431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.855781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 879/1750] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:14.861877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:14.876220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02a568-3a2d-4f75-9fa9-8ab7a9df50da None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:14.882815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:14.883801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:14.884235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:14.884654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:14.885609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:14.887722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903aed8-5dad-46b3-a2b6-08321580a982 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:14.929688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 872/1751] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:14.936820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:14.951204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7725bd6-958c-4993-bcf6-1277b4368c25 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:15.107319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c236bda-6768-4b31-b096-d76264cf1585 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.108000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c236bda-6768-4b31-b096-d76264cf1585 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.108503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c236bda-6768-4b31-b096-d76264cf1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.133337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:15.134619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.135163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.135696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.136676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:15.138849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:15.187300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 880/1752] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:14 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:15.188374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:15.216988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f5297-c576-4ceb-9165-a964a722fb4f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:15.230996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:15.232438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.233717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.233947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.235376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:15.238044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:15.250247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c236bda-6768-4b31-b096-d76264cf1585 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:15.254322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c236bda-6768-4b31-b096-d76264cf1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:15.270998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 881/1753] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:15.276519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:15.306457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed238-2b68-44bc-860c-add0a70f51d6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:15.326028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:15.326998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.327427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.327704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.328474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:15.335798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:15.364897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 882/1754] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:15.369604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:15.395070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53800c8-59ae-4560-8a4a-7ed9d725203f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:15.412682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:15.413386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.413672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.414589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] PATH_INFO: `/v3/projects/cfd2f2e91b01485dbeea21342ac124b0/users/4e7c53ad326a477ba4b09902b8313c6c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.461357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 873/1755] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:22:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:15.474267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd2f2e91b01485dbeea21342ac124b0, user_id=4e7c53ad326a477ba4b09902b8313c6c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:15.477003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:15.506030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:15.512790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 883/1756] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:15 2022] PUT /identity/v3/projects/cfd2f2e91b01485dbeea21342ac124b0/users/4e7c53ad326a477ba4b09902b8313c6c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:15.526804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.527443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.527870 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.631241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] MFA Rules not processed for user `4e7c53ad326a477ba4b09902b8313c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:15.632657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:15.679179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:15.683018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:15.830360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 874/1757] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:15.838216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:15.840157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:15.902683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de55c-bdd0-43a6-a657-6df18175f553 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:15.932088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:15.934043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:15.935052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:15.936714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] PATH_INFO: `/v3/users/bdf393888f5d449b9e06efc40b50f155` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:15.944527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf393888f5d449b9e06efc40b50f155)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:15.951412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:15.961245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.091762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf393888f5d449b9e06efc40b50f155'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.093144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf393888f5d449b9e06efc40b50f155'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.094943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf393888f5d449b9e06efc40b50f155'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.107453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf393888f5d449b9e06efc40b50f155'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.145918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf393888f5d449b9e06efc40b50f155'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.178750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 884/1758] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:15 2022] DELETE /identity/v3/users/bdf393888f5d449b9e06efc40b50f155 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:16.179259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4dd3-5cde-4d08-aac7-d4ed88d54d1a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:16.180527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:16.184454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:16.285348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882136-c5b7-4601-b0f6-f499c8b481dc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:16.292676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:16.293709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.294090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.294465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.295226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:16.297859 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:16.311761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:16.311761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.312107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.312179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.325614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:16.342354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 885/1759] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:16 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:16.343999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:16.346844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:16.367460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.481394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:16.484756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2daf8-00e7-4e32-b194-aa591b5b2984 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:16.488180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b941d-dd48-4ef4-956d-bb684837abad admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:16.495053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:16.495658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.495971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.496252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] PATH_INFO: `/v3/projects/8a0bf7e1302a4b99b7583ed965f4a2d9` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.497469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0bf7e1302a4b99b7583ed965f4a2d9)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:16.500579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 875/1760] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:22:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:22:16.507559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.509302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.509750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.511507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:16.554336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:16.556648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:16.597152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 876/1761] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:16.598700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:16.621986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d848f-bb82-4dfc-a27b-cb8992724ea8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:16.655310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:16.655899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.656199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.656469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.657617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:16.672476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6b2b-ecc8-4bbf-85b3-7aef85d11b95 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:16.738899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 877/1762] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:16 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:16.740369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:16.740668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:16.740983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:16.796610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] MFA Rules not processed for user `83cdff24514c42679e46d8f5b7c27fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:16.798581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:16.842586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0bf7e1302a4b99b7583ed965f4a2d9', 'request_id': 'req-2b05af55-4de3-4a27-b1da-3979848773dd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.875185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0bf7e1302a4b99b7583ed965f4a2d9', 'request_id': 'req-2b05af55-4de3-4a27-b1da-3979848773dd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.879189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:16.910213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0bf7e1302a4b99b7583ed965f4a2d9', 'request_id': 'req-2b05af55-4de3-4a27-b1da-3979848773dd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.970181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] The token cache is being invalidate because project 8a0bf7e1302a4b99b7583ed965f4a2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:16.970598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.971276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:16.974623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 886/1763] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:16 2022] DELETE /identity/v3/projects/8a0bf7e1302a4b99b7583ed965f4a2d9 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:16.975433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:16.989441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.001428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 878/1764] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:17.002648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:17.012522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.302579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf3ab-64f8-4561-be09-fc286658e56d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:17.318164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05af55-4de3-4a27-b1da-3979848773dd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:17.324070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:17.324616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:17.324924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:17.325367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:17.334433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:17.340730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:17.350976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:17.352157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:17.357194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:17.357941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:17.376145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.408659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 879/1765] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:17.410359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:17.417135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.474313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:17.479218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:17.492840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae714-cbd2-4780-8103-16be91c7adb1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:17.514337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:17.517057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:17.519577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:17.520107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] PATH_INFO: `/v3/users/1ace107ddfce46d58747bd75dc81fe46` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:17.523528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ace107ddfce46d58747bd75dc81fe46)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:17.527447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 887/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:17.529019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:17.552295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:17.609466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b106cf-52d2-4984-b355-2eeca071fa2b service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:17.654124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:17.657873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:17.658039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:17.658300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:17.663100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:17.676523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ccbc2-fc10-4aa8-a25f-3adca5dde967 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:17.687660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ace107ddfce46d58747bd75dc81fe46'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:17.722825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ace107ddfce46d58747bd75dc81fe46'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:17.723463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ace107ddfce46d58747bd75dc81fe46'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:17.739227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 888/1767] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:17.741282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254cb68-50b3-4ff7-8666-94007ede328f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:17.743657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254cb68-50b3-4ff7-8666-94007ede328f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:17.744638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254cb68-50b3-4ff7-8666-94007ede328f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:17.753952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ace107ddfce46d58747bd75dc81fe46'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:17.810108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e254cb68-50b3-4ff7-8666-94007ede328f None None] MFA Rules not processed for user `fc564035b8ee4029a9caced9064f69cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:17.823042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e254cb68-50b3-4ff7-8666-94007ede328f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.823257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ace107ddfce46d58747bd75dc81fe46'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:17.849717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 880/1768] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:17 2022] DELETE /identity/v3/users/1ace107ddfce46d58747bd75dc81fe46 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:17.852859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:17.861246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:17.922104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:18.027406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:18.080350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 889/1769] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:18.082746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51447d9-bdda-4e3c-a93c-b51915e70424 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:18.114260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:18.123275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:18.123522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:18.125488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] PATH_INFO: `/v3/projects/05e1a42c8a274c3a83ed3bf67f2fbfec/users/1bbc5c64538f49eabb2b8046a5ff512e/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:18.192814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e1a42c8a274c3a83ed3bf67f2fbfec, user_id=1bbc5c64538f49eabb2b8046a5ff512e, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:18.197848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:18.266256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 881/1770] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:17 2022] PUT /identity/v3/projects/05e1a42c8a274c3a83ed3bf67f2fbfec/users/1bbc5c64538f49eabb2b8046a5ff512e/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:18.278618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:18.279331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:18.279788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:18.388509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] MFA Rules not processed for user `1bbc5c64538f49eabb2b8046a5ff512e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:18.399772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:18.611988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 890/1771] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:18.615563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:18.756284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eb2e5-c5f1-4e34-b6db-6763c89c24aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:18.762115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:18.762628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:18.763033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:18.763883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:18.764343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:18.766728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:18.826028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 882/1772] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:18 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:18.827138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:18.861598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1174d77-1834-45e6-be9c-f62454a110e6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:18.969806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:18.971400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:18.971672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:18.971954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:18.972576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:18.974513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.023587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 891/1773] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:18 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:19.039641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.071370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822b8a2-eac5-4fbb-a75e-933342b38e33 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:19.090663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:19.091840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.092118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.092399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.099677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:19.107627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d0456-df48-46e2-ab7f-0d8060046e64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.147314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 883/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:19.149124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.175493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ea05-c6c1-4c67-b0ed-6ce5de19dd1b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:19.185663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:19.186822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.187315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.187680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] PATH_INFO: `/v3/projects/76f189f763f04ba98dbc0689860a341c/users/9c74d566a104416b9a5f4ff745d88eee/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.196243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9992-938a-4d31-9514-479991128e02 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.196881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9992-938a-4d31-9514-479991128e02 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.197458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9992-938a-4d31-9514-479991128e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.285649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f189f763f04ba98dbc0689860a341c, user_id=9c74d566a104416b9a5f4ff745d88eee, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:19.303209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.304288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-350c9992-938a-4d31-9514-479991128e02 None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:19.310715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-350c9992-938a-4d31-9514-479991128e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:19.349758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 892/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:19 2022] PUT /identity/v3/projects/76f189f763f04ba98dbc0689860a341c/users/9c74d566a104416b9a5f4ff745d88eee/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:19.356144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.431106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:19.540149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 884/1776] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:19.543281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c99-2313-40a9-8cbe-9e4f4a5fee91 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.544645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c99-2313-40a9-8cbe-9e4f4a5fee91 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.545177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c99-2313-40a9-8cbe-9e4f4a5fee91 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.553925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 885/1777] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 17 11:22:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:19.561393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.561998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.562408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.575134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f15e4-de9a-4414-bfc5-a978a992c9f4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:19.608314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:19.608974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.609240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.609513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.622135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:19.622636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:19.627545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:19.631958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.702503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 893/1778] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:19.709749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.729558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:19.747849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 886/1779] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:19.777033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.778760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:19.780456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1364bc-5b5e-4648-ab24-7185ab2705bb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:19.793807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32f902-8fce-478e-979e-0a9c7fa069ff None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:19.803819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:19.804839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.805380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.806644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.810670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:19.811446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.813803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.814132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] PATH_INFO: `/v3/projects/76f189f763f04ba98dbc0689860a341c/users/9c74d566a104416b9a5f4ff745d88eee/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.821889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f189f763f04ba98dbc0689860a341c, user_id=9c74d566a104416b9a5f4ff745d88eee, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:19.825759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:19.830372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.844353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e162-5ce0-4412-8441-d3b80cde5e63 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:19.864305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 887/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:19.866930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:19.870517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:19.888833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 894/1781] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:19 2022] PUT /identity/v3/projects/76f189f763f04ba98dbc0689860a341c/users/9c74d566a104416b9a5f4ff745d88eee/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:19.904607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0bfaf-c159-48ce-a092-d3f710eb09e0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:19.904925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0bfaf-c159-48ce-a092-d3f710eb09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:19.905447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0bfaf-c159-48ce-a092-d3f710eb09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:19.937369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e9b26-0e2a-4b9e-af56-6a5ddd671cb6 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:20.035603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1bb0bfaf-c159-48ce-a092-d3f710eb09e0 None None] MFA Rules not processed for user `9c74d566a104416b9a5f4ff745d88eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:20.039286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1bb0bfaf-c159-48ce-a092-d3f710eb09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:20.144700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:20.145505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:20.146187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:20.146478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:20.158350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:20.160341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:20.176169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 888/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:20.293943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 895/1783] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:20.304788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:20.306655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:20.448460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acdc78-6756-404c-928a-5671433a893d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:20.448863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acdc78-6756-404c-928a-5671433a893d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:20.449033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acdc78-6756-404c-928a-5671433a893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:20.495135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198f91b-d24c-492f-a325-14f6fe4a60c8 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:20.497556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-63acdc78-6756-404c-928a-5671433a893d None None] MFA Rules not processed for user `9c06d5a51e984f36879bbb86b6d60513`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:20.499219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-63acdc78-6756-404c-928a-5671433a893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:20.507441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:20.508579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:20.509316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:20.509798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:20.538274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:20.542434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:20.585581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 889/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:20.624150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 896/1785] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:20.920939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:20.924818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:21.227273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416daf9d-66fa-4a80-a38d-6d47dc9fe636 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:21.240645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:21.241202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:21.241478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:21.241795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] PATH_INFO: `/v3/projects/ea5e5772c145441fb604ca6f3d184f39` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:21.277982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5e5772c145441fb604ca6f3d184f39)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:21.287457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:21.355454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acdc78-6756-404c-928a-5671433a893d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:21.357575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-63acdc78-6756-404c-928a-5671433a893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:21.400032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acdc78-6756-404c-928a-5671433a893d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:21.443656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:21.444317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:21.449679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:21.449965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:21.452829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] PATH_INFO: `/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:21.457191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b6ffe9b6b64d8aadc58de0e77fd167)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:21.472263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:21.498820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5e5772c145441fb604ca6f3d184f39', 'request_id': 'req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.521538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5e5772c145441fb604ca6f3d184f39', 'request_id': 'req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.548872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5e5772c145441fb604ca6f3d184f39', 'request_id': 'req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.644215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] The token cache is being invalidate because project ea5e5772c145441fb604ca6f3d184f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:21.651366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.657568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.674978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 890/1786] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:20 2022] DELETE /identity/v3/projects/ea5e5772c145441fb604ca6f3d184f39 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:21.679458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:21.692836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:21.755118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:21.828883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b6ffe9b6b64d8aadc58de0e77fd167', 'request_id': 'req-db4e14e9-5df7-45a4-b351-3aefb60bbb84'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.854937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b6ffe9b6b64d8aadc58de0e77fd167', 'request_id': 'req-db4e14e9-5df7-45a4-b351-3aefb60bbb84'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.898457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b6ffe9b6b64d8aadc58de0e77fd167', 'request_id': 'req-db4e14e9-5df7-45a4-b351-3aefb60bbb84'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.969832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] The token cache is being invalidate because project 23b6ffe9b6b64d8aadc58de0e77fd167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:21.971309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:21.973701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db4e14e9-5df7-45a4-b351-3aefb60bbb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.003496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 897/1787] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:21 2022] DELETE /identity/v3/projects/23b6ffe9b6b64d8aadc58de0e77fd167 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:22.008883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551649-bd0e-4038-99f9-692dc5e1de5d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:22.009180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551649-bd0e-4038-99f9-692dc5e1de5d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:22.009462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551649-bd0e-4038-99f9-692dc5e1de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:22.071467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ad9b3-c0f1-4f4e-9fe9-c572b045de99 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:22.106034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c5551649-bd0e-4038-99f9-692dc5e1de5d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:22.107841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c5551649-bd0e-4038-99f9-692dc5e1de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:22.297148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:22.301624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:22.301901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:22.302178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] PATH_INFO: `/v3/users/2e6b9577faec4dc2932b6de4a85d5d61` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:22.309024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6b9577faec4dc2932b6de4a85d5d61)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:22.316589 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:22.424591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 898/1788] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:22.431867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:22.432844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:22.433597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:22.485969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6b9577faec4dc2932b6de4a85d5d61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.498959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:22.502245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:22.504837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6b9577faec4dc2932b6de4a85d5d61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.506013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6b9577faec4dc2932b6de4a85d5d61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.524201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 899/1789] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:22.528144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:22.529229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6b9577faec4dc2932b6de4a85d5d61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.559883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:22.576088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6b9577faec4dc2932b6de4a85d5d61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:22.594712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 891/1790] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:21 2022] DELETE /identity/v3/users/2e6b9577faec4dc2932b6de4a85d5d61 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:22.595873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:22.601290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:22.606247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b861933-a042-429c-93b0-2de0a039de78 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:22.808030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0c99-0481-4075-8fae-26b550e99494 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:22.824114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:22.825149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:22.825452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:22.825726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:22.835748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:22.872298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:22.875758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:22.876129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:22.877223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:22.881606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:22.885740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:22.888378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:22.934288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 900/1791] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:22.939187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:22.945687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:23.019298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad74a-9203-47e8-a0f2-675acc2095f1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:23.037628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:23.042121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.043884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.045451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:23.048249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.053176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.104955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.107519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.162160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 892/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:23.171089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 901/1793] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:22 2022] POST /identity/v3/projects => generated 371 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:23.175236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:23.218656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32e8a9-5697-4fad-8df1-85b8582b4b55 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:23.382987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:23.384017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.384555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.385196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:23.386275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.388860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.420532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 893/1794] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:23 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:23.427700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:23.447754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb831a0-5cf3-4a74-9586-23f4eda98bd2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:23.473018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:23.473694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.473976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.474250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:23.475058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.497068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.577820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 902/1795] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:23.582368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:23.601988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68bda-64db-41ce-83c1-720fbeddfb73 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:23.626343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:23.628900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.630506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.631737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:23.635859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.643894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89d8a9-dc66-4269-8906-cce783faf0b6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.678633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 894/1796] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:23.683642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:23.731301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9893-5dac-45d0-a126-e57e31dbf590 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:23.746050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:23.749245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.751643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.753332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] PATH_INFO: `/v3/projects/61ea3df9e1d3424ba6a571782d04b9b2/users/fd037159ae114915a68ad4f97cd5b92a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:23.816791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ea3df9e1d3424ba6a571782d04b9b2, user_id=fd037159ae114915a68ad4f97cd5b92a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:23.869421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:23.891980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:23.944853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 903/1797] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:23 2022] PUT /identity/v3/projects/61ea3df9e1d3424ba6a571782d04b9b2/users/fd037159ae114915a68ad4f97cd5b92a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:23.950368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffbd6-5b72-4606-a248-da3e1e94284e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:23.950897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffbd6-5b72-4606-a248-da3e1e94284e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:23.951249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cffbd6-5b72-4606-a248-da3e1e94284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:24.024339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-75cffbd6-5b72-4606-a248-da3e1e94284e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:24.028949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75cffbd6-5b72-4606-a248-da3e1e94284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:24.096630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:24.308838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 895/1798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:24.436916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:24.440238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:24.574446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd4a2-9fe7-4c10-825a-f92cfceeacae admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:24.582655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:24.583581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:24.584036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:24.584462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:24.608144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:24.610903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b13c-0c59-400b-bccd-ac6e965a3753 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:24.649342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 904/1799] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:24.961960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:24.962887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:24.963527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:24.965975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 896/1800] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:22:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:25.017569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:25.017974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:25.018112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:25.084067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:25.088291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:25.415533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 905/1801] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:22:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:25.919823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:25.923473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:25.969904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c868e86-8ddb-4bf1-b608-67094b4c16e8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:25.985049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:25.986078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:25.986531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:25.987440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:26.056353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:26.062612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddc3df-767f-4696-b5bb-9920f101cf88 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:26.112326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 897/1802] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:26.309531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:26.313440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:26.346038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc16c8-5d7c-4dac-aa17-28f76c8b46ba None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:26.391292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:26.391941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:26.396555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:26.396846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] PATH_INFO: `/v3/projects/f80f9a46d072465caf6fd124d23cfa62` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:26.401042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80f9a46d072465caf6fd124d23cfa62)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:26.410705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:26.603189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80f9a46d072465caf6fd124d23cfa62', 'request_id': 'req-15690151-15aa-434d-820a-ce89d2f32c85'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:26.632633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80f9a46d072465caf6fd124d23cfa62', 'request_id': 'req-15690151-15aa-434d-820a-ce89d2f32c85'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:26.661038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80f9a46d072465caf6fd124d23cfa62', 'request_id': 'req-15690151-15aa-434d-820a-ce89d2f32c85'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:26.749965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] The token cache is being invalidate because project f80f9a46d072465caf6fd124d23cfa62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:26.750311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:26.751247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-15690151-15aa-434d-820a-ce89d2f32c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:26.757589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 906/1803] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:26 2022] DELETE /identity/v3/projects/f80f9a46d072465caf6fd124d23cfa62 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:26.762682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:26.763761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:26.764389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:26.835695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:26.837493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:27.077708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 898/1804] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:27.087118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083260-1610-448c-9105-5da11b26a088 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.088985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083260-1610-448c-9105-5da11b26a088 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.089675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81083260-1610-448c-9105-5da11b26a088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.166482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-81083260-1610-448c-9105-5da11b26a088 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:27.169646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-81083260-1610-448c-9105-5da11b26a088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:27.206098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 907/1805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:27.212884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.233216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f244-d0d8-4308-b2c8-5ab9d9b5da30 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.249183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.254078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.254719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.255249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.258952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:27.260397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:27.270170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:27.316179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 899/1806] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:22:27.321602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083260-1610-448c-9105-5da11b26a088 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.332194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:27.338306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81083260-1610-448c-9105-5da11b26a088 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.349167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.351431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.352181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.353038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.356011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:27.361466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:27.423526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 908/1807] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:27 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:27.426918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.475314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9e264-6255-4fe5-b533-9c056abe80f3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.646261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.648671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.649306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.649740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.651717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:27.657562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:27.714177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 900/1808] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:27 2022] POST /identity/v3/users => generated 283 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:27.716133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.750331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f8984-e52b-454a-b23d-79211aa15cad admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.763659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.764639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.765120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.765750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.767154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:27.770573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:27.801715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 909/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:27.805820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.837078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8ed58-64e2-4b85-998d-d1429eeb3a90 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.863930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.865653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.866829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.867525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:27.870160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:27.874518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3af3-75bc-4cfb-b76b-cbc8005d3f7c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:27.906800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 901/1810] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:27.911961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:27.925878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48e4a7-f555-40f2-9ee0-3a7d70542b33 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:27.938373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:27.940349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:27.940892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:27.941275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] PATH_INFO: `/v3/projects/f9022f2c5af944d882e2ed75670e9b97/users/4082c27a7ea24121a5da55e915f1941c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:28.003717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9022f2c5af944d882e2ed75670e9b97, user_id=4082c27a7ea24121a5da55e915f1941c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:28.019353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:28.074056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 910/1811] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:27 2022] PUT /identity/v3/projects/f9022f2c5af944d882e2ed75670e9b97/users/4082c27a7ea24121a5da55e915f1941c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:28.076201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:28.076861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:28.077234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:28.153214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:28.161421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] MFA Rules not processed for user `4082c27a7ea24121a5da55e915f1941c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:28.165832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:28.504587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 902/1812] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:28.507744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:28.737404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c9cb-e245-45d2-9077-a06569f20c41 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:28.784824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:28.785547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:28.794733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:28.795117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:28.795847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:28.797996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:28.925971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 911/1813] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:28 2022] POST /identity/v3/projects => generated 363 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:28.927469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:28.957171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f2a24-d3d1-4c5a-9055-61a241ea0437 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:29.308708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:29.325489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:29.336741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:29.337036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:29.343735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:29.361496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:29.369050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:29.379826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:29.458014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 903/1814] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:28 2022] POST /identity/v3/users => generated 288 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:29.458978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:29.487854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa0050-e46d-4d0a-aceb-397670fa15a2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:29.517753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96896e-caaf-4972-8d70-84098f0a27bc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:29.526561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:29.527194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:29.527510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:29.527793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:29.528261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:29.528484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:29.531501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:29.531751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:29.532594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:29.533025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:29.535833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:29.587013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 904/1815] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:29.588082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:29.614671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c1370-ce3e-4c19-84fa-ad7807ead7df admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:29.615022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:29.624452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:29.625191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:29.625476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:29.626008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] PATH_INFO: `/v3/projects/66090dfa887d4740b18dc4512526a6cd/users/15df37fba2d44d31b05985c4f9d8369a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:29.650726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:29.653079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:29.685928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 912/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:29.691655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66090dfa887d4740b18dc4512526a6cd, user_id=15df37fba2d44d31b05985c4f9d8369a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:29.698985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:29.746287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 905/1817] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:29 2022] PUT /identity/v3/projects/66090dfa887d4740b18dc4512526a6cd/users/15df37fba2d44d31b05985c4f9d8369a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:29.751310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:29.775620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad511-a623-4c5e-8515-1e5542125f8a service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:29.947004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:29.947650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:29.947952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:29.951208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:29.952046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:29.956629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e993-d7a2-4aa3-add5-0228ec98d791 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:29.993674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 913/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:29.994889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:30.017609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d75e-adb4-4a02-9235-fcdb00a487e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:30.037742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:30.038553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:30.038968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:30.039206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] PATH_INFO: `/v3/projects/66090dfa887d4740b18dc4512526a6cd/users/15df37fba2d44d31b05985c4f9d8369a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:30.041666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66090dfa887d4740b18dc4512526a6cd, user_id=15df37fba2d44d31b05985c4f9d8369a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:30.044922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:30.082335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 906/1819] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:29 2022] PUT /identity/v3/projects/66090dfa887d4740b18dc4512526a6cd/users/15df37fba2d44d31b05985c4f9d8369a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:30.088273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:30.088570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:30.088904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:30.190735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] MFA Rules not processed for user `15df37fba2d44d31b05985c4f9d8369a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:30.192059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:30.373236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 914/1820] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:30.388082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:30.390644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:30.517155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:30.557181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10559b61-4e22-4e09-bd6e-a34c25b03cb1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:30.567597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:30.568289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:30.568543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:30.568860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:30.588081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:30.590491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482c66b-91c0-44fe-a19f-ca7b25bebc28 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:30.627769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 907/1821] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:30.840780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:30.858664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd661-7481-4564-aa31-a1e62b0379fb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:30.873725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:30.877358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:30.883192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:30.883647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:30.899855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:30.900298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:30.900587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:30.962978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] MFA Rules not processed for user `fd037159ae114915a68ad4f97cd5b92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:30.965702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:31.105406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:31.109685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964754cd-ad3c-493e-83f7-b64802ebb572 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:31.120583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 908/1822] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:31.146599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 915/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:31.482123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:31.498843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a88474-a24b-447a-af34-db9300aa6d01 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:31.518683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:31.522685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:31.523162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:31.523361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:31.564872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:31.566944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8f987-1ef2-4215-85bf-d94e3d1ba8f2 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:31.590939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 909/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:31.988551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:31.989515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:31.990204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:31.992222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 916/1825] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:22:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:32.212723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:32.213018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:32.213285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:32.270424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:32.271719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:32.520023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 910/1826] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:32.628059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:32.630490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:32.658852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa983a-a23f-42ca-ae9e-12643b34226a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:32.668341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:32.669956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:32.670529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:32.671183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:32.679496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:32.688142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:32.690977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96a115-ad28-4320-bcb0-d034f48aa7d4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:32.726802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 917/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:33.312355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:33.314670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:33.554212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:33.567891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfee4e-bf6a-4244-b203-a0a5e139b974 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:33.585896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:33.588232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:33.589218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:33.590447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] PATH_INFO: `/v3/users/4e7c53ad326a477ba4b09902b8313c6c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:33.592701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7c53ad326a477ba4b09902b8313c6c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:33.599332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:33.659214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097389-40b6-4ca8-b698-9c7c883258a1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:33.659856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097389-40b6-4ca8-b698-9c7c883258a1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:33.659856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097389-40b6-4ca8-b698-9c7c883258a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:33.706254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-24097389-40b6-4ca8-b698-9c7c883258a1 None None] MFA Rules not processed for user `fd037159ae114915a68ad4f97cd5b92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:33.708906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-24097389-40b6-4ca8-b698-9c7c883258a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:33.710151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7c53ad326a477ba4b09902b8313c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:33.719627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 918/1828] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:33.746887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7c53ad326a477ba4b09902b8313c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:33.748010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7c53ad326a477ba4b09902b8313c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:33.758053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7c53ad326a477ba4b09902b8313c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:33.801399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7c53ad326a477ba4b09902b8313c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:33.817134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 911/1829] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:33 2022] DELETE /identity/v3/users/4e7c53ad326a477ba4b09902b8313c6c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:33.821728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:33.822519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:33.822875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:33.861483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:33.864596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:33.940026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 919/1830] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:33.949867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:33.951331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:34.019389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75fc0-10f0-4bd7-a1d9-f3943a47cec5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:34.025394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:34.027103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:34.027957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:34.027957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:34.038525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:34.040097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:34.051801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 912/1831] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:34.775204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:34.776903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:34.798559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8b05-dcdd-4479-901d-26c97518b3a7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:34.817559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:34.818663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:34.818971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:34.819242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] PATH_INFO: `/v3/projects/cfd2f2e91b01485dbeea21342ac124b0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:34.820650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd2f2e91b01485dbeea21342ac124b0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:34.822984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:34.954510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd2f2e91b01485dbeea21342ac124b0', 'request_id': 'req-85191a62-22f1-49a7-bbce-f0bb60779601'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:34.970974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd2f2e91b01485dbeea21342ac124b0', 'request_id': 'req-85191a62-22f1-49a7-bbce-f0bb60779601'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:34.984648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd2f2e91b01485dbeea21342ac124b0', 'request_id': 'req-85191a62-22f1-49a7-bbce-f0bb60779601'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.005950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] The token cache is being invalidate because project cfd2f2e91b01485dbeea21342ac124b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:35.006175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.007311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.010015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 920/1832] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:34 2022] DELETE /identity/v3/projects/cfd2f2e91b01485dbeea21342ac124b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:35.014288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:35.032867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246e9-a4cb-4c0a-9ade-d2e7ed333f13 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:35.049791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:35.052879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:35.122265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:35.123264 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:35.123765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:35.124780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] PATH_INFO: `/v3/users/1bbc5c64538f49eabb2b8046a5ff512e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:35.127366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbc5c64538f49eabb2b8046a5ff512e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:35.130116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:35.177980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85191a62-22f1-49a7-bbce-f0bb60779601 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:35.181067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:35.184324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:35.185985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:35.186609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:35.187312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] PATH_INFO: `/v3/users/4082c27a7ea24121a5da55e915f1941c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:35.189746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4082c27a7ea24121a5da55e915f1941c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:35.192318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:35.210354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:35.225682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbc5c64538f49eabb2b8046a5ff512e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.237772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbc5c64538f49eabb2b8046a5ff512e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.238955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbc5c64538f49eabb2b8046a5ff512e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.263808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4082c27a7ea24121a5da55e915f1941c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.264456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4082c27a7ea24121a5da55e915f1941c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.266542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4082c27a7ea24121a5da55e915f1941c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.269148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbc5c64538f49eabb2b8046a5ff512e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.276967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4082c27a7ea24121a5da55e915f1941c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.287178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-530ca09c-6cce-4d13-8cad-5386de948a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbc5c64538f49eabb2b8046a5ff512e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.293623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4082c27a7ea24121a5da55e915f1941c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:35.295174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 913/1833] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:35 2022] DELETE /identity/v3/users/1bbc5c64538f49eabb2b8046a5ff512e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:35.312363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 921/1834] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:35 2022] DELETE /identity/v3/users/4082c27a7ea24121a5da55e915f1941c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:35.317146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:35.317433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:35.317708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:35.338881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:35.340163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:35.424596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 914/1835] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:35.442266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:35.444154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:35.513610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f561c45-6d10-4200-92a3-3699a57c9b10 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:35.517628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:35.518353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:35.518715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:35.519051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:35.529271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:35.530703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:35.541268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 922/1836] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:36.161553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:36.163128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:36.181508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaeb2ce-0a9b-482e-8759-efa73f7ddae6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:36.192660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:36.193266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:36.193546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:36.193820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] PATH_INFO: `/v3/projects/05e1a42c8a274c3a83ed3bf67f2fbfec` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:36.204888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e1a42c8a274c3a83ed3bf67f2fbfec)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:36.206940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:36.292969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e1a42c8a274c3a83ed3bf67f2fbfec', 'request_id': 'req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.304934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e1a42c8a274c3a83ed3bf67f2fbfec', 'request_id': 'req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.317448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e1a42c8a274c3a83ed3bf67f2fbfec', 'request_id': 'req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.336522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] The token cache is being invalidate because project 05e1a42c8a274c3a83ed3bf67f2fbfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:36.336919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.337654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.340525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 915/1837] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:36 2022] DELETE /identity/v3/projects/05e1a42c8a274c3a83ed3bf67f2fbfec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:36.344645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:36.361553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69dbed-9928-4a3e-bb0c-03130b99cf92 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:36.443364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:36.445026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:36.460599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:36.461329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:36.461645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:36.462025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] PATH_INFO: `/v3/users/9c74d566a104416b9a5f4ff745d88eee` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:36.463466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c74d566a104416b9a5f4ff745d88eee)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:36.465512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:36.473563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:36.534994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:36.561229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c74d566a104416b9a5f4ff745d88eee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.563785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c74d566a104416b9a5f4ff745d88eee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.564583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c74d566a104416b9a5f4ff745d88eee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.574508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c74d566a104416b9a5f4ff745d88eee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.577118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57f6a8-cb5a-460b-983d-a9f1a3fecc28 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:36.585507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:36.586354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:36.586793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:36.587232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] PATH_INFO: `/v3/projects/f9022f2c5af944d882e2ed75670e9b97` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:36.588572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9022f2c5af944d882e2ed75670e9b97)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:36.591299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:36.595336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c74d566a104416b9a5f4ff745d88eee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.618150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 923/1838] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:36 2022] DELETE /identity/v3/users/9c74d566a104416b9a5f4ff745d88eee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:36.657633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9022f2c5af944d882e2ed75670e9b97', 'request_id': 'req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.663818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9022f2c5af944d882e2ed75670e9b97', 'request_id': 'req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.672860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9022f2c5af944d882e2ed75670e9b97', 'request_id': 'req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.683631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] The token cache is being invalidate because project f9022f2c5af944d882e2ed75670e9b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:36.683945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.684611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.686257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 916/1839] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:36 2022] DELETE /identity/v3/projects/f9022f2c5af944d882e2ed75670e9b97 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:36.690761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:36.692384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:36.780217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bcdbc-e997-4833-9078-509a9fe2cb53 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:36.877701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:36.878874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:36.879298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:36.880047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] PATH_INFO: `/v3/users/15df37fba2d44d31b05985c4f9d8369a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:36.882131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] RBAC: Authorizing `identity:delete_user(user_id=15df37fba2d44d31b05985c4f9d8369a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:36.885989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:36.958832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15df37fba2d44d31b05985c4f9d8369a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.959506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15df37fba2d44d31b05985c4f9d8369a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.960231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15df37fba2d44d31b05985c4f9d8369a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.976166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15df37fba2d44d31b05985c4f9d8369a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:36.981369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:36.991978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7b464dea-51e9-409d-aec8-e27c38eb64be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15df37fba2d44d31b05985c4f9d8369a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.008592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 924/1840] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:36 2022] DELETE /identity/v3/users/15df37fba2d44d31b05985c4f9d8369a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:37.101043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.102520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.119134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e86bd-e471-4b4e-aca1-cb2f12a2ae84 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:37.181244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:37.181985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.182155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.182426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] PATH_INFO: `/v3/projects/76f189f763f04ba98dbc0689860a341c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.183554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f189f763f04ba98dbc0689860a341c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:37.185548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:37.274824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f189f763f04ba98dbc0689860a341c', 'request_id': 'req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.277697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:37.289021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f189f763f04ba98dbc0689860a341c', 'request_id': 'req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.302843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f189f763f04ba98dbc0689860a341c', 'request_id': 'req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.314723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] The token cache is being invalidate because project 76f189f763f04ba98dbc0689860a341c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:37.315046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.315756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.318260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 917/1841] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:37 2022] DELETE /identity/v3/projects/76f189f763f04ba98dbc0689860a341c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:37.324229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0096-8aa7-4cc4-8fa0-76997fb8a9a7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.324511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0096-8aa7-4cc4-8fa0-76997fb8a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.325477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b0096-8aa7-4cc4-8fa0-76997fb8a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.333076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.334523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.351497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-749b0096-8aa7-4cc4-8fa0-76997fb8a9a7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:37.352758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-749b0096-8aa7-4cc4-8fa0-76997fb8a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.484992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa4205-008b-4574-8d9d-23df0bbc4d6e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:37.500624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:37.501423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.501797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.502065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] PATH_INFO: `/v3/projects/66090dfa887d4740b18dc4512526a6cd` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.503320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66090dfa887d4740b18dc4512526a6cd)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:37.506654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:37.602121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 925/1842] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:37.603256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66090dfa887d4740b18dc4512526a6cd', 'request_id': 'req-5ee92391-0e66-4b50-b258-98e23579308b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.604226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.604516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.604808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.623456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66090dfa887d4740b18dc4512526a6cd', 'request_id': 'req-5ee92391-0e66-4b50-b258-98e23579308b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.645212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66090dfa887d4740b18dc4512526a6cd', 'request_id': 'req-5ee92391-0e66-4b50-b258-98e23579308b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.655962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:37.657296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.673279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] The token cache is being invalidate because project 66090dfa887d4740b18dc4512526a6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:37.673573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.675240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5ee92391-0e66-4b50-b258-98e23579308b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:37.681384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 918/1843] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:37 2022] DELETE /identity/v3/projects/66090dfa887d4740b18dc4512526a6cd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:37.682798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484363-3950-4f2b-a33c-d44a9d08b05d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.683082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484363-3950-4f2b-a33c-d44a9d08b05d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.683366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484363-3950-4f2b-a33c-d44a9d08b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.726410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1b484363-3950-4f2b-a33c-d44a9d08b05d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:37.729164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1b484363-3950-4f2b-a33c-d44a9d08b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.766088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 926/1844] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:37.770232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.782185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f795c71-e1d7-4515-8816-08e25e3510dd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:37.795129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:37.797981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.798764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.799756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.802443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:37.802912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:37.804844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:37.825120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 927/1845] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:37.829053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.833882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 919/1846] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:37.842633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.843304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.843408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.861323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486641f-d822-4bb5-b9fd-7c22e2a1a2bc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:37.868336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:37.869681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:37.883272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:37.884236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.885309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.885620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.886479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:37.892294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:37.903552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 920/1847] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:37.908446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.930165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:37.934600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1caa5-f497-483c-acd4-f2cf5dbafd26 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:37.942017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:37.942928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:37.943448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:37.944404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:37.945082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:37.945459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:37.947238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:37.963479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 921/1848] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:37.969065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.974187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 928/1849] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:37.975962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:37.993492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4345-470f-41df-9686-61d9174d8afd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.047943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:38.079744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd77fde-263c-437d-83f7-a3e10bd7e087 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.087827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.088743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.089024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.089298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.089946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.091546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.092231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.092363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.092533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.092849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.093577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.095692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.136488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 922/1850] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:38.136740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 929/1851] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:37 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:38.138263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.139247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.164456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b81d6-8e44-4332-977f-e8aa5c0725b7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.246812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb491e-a8cd-4840-824a-7a035c112945 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.255846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.256810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.257160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.257501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.258290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.260547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.291729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 923/1852] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:38.294366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.307034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b18fa-59cb-45a3-98f9-8c64c70e68ce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.308961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.309747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.310140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.310457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.311324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.313439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.327307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 930/1853] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:38.329289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.330152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.330438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.331813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.333465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.335712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.340571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.351468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0bfaa-e6fe-4b57-860c-45409e37362a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.357275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.358074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.359208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.359479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.368132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.370841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.374420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 924/1854] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:38.380777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.394078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 931/1855] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:38.396336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.399038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0e27e-b0fc-47a0-a382-448587303993 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.406039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566a03e-0164-4c01-b7e3-d2ecb2c76e64 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.409030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.409876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.410829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.410950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.411160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.411576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.411770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.411945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.412239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] PATH_INFO: `/v3/projects/08c87847dec14afd89188c4588d69be7/users/bdfcb7d055eb44a89c7c9de21b893a65/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.417501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.435334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c87847dec14afd89188c4588d69be7, user_id=bdfcb7d055eb44a89c7c9de21b893a65, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.438405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f6442-e466-4c4a-9a90-0da12cb669f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.440369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 925/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:38.444616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.464815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756971d-503b-4b30-9978-827f888c7c00 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.472297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 932/1857] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:38 2022] PUT /identity/v3/projects/08c87847dec14afd89188c4588d69be7/users/bdfcb7d055eb44a89c7c9de21b893a65/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:38.486571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.486764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.487472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.518908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] MFA Rules not processed for user `bdfcb7d055eb44a89c7c9de21b893a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:38.521429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:38.555785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:38.615116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.616271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.617219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.617659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] PATH_INFO: `/v3/projects/4d710a0e7fb34438959e1fb39f707719/users/2d9ffa12459841b3bb70f53bb9b7ddab/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.656428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d710a0e7fb34438959e1fb39f707719, user_id=2d9ffa12459841b3bb70f53bb9b7ddab, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.659668 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0228a-a00e-4232-8896-f6bf2b211b93 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.661668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 933/1858] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:38.662598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.679096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee63c20-d0b3-46e5-8219-bef20f255232 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.693376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 926/1859] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:38 2022] PUT /identity/v3/projects/4d710a0e7fb34438959e1fb39f707719/users/2d9ffa12459841b3bb70f53bb9b7ddab/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:38.694981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.695314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.695614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.707611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:38.765225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.765987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.766124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] MFA Rules not processed for user `2d9ffa12459841b3bb70f53bb9b7ddab`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:38.766450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.766809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.767605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.769683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.778089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:38.825417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 934/1860] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:38.829466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.950802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 927/1861] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:38.952981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:38.977284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e882-9799-4a26-9206-fc38d7179910 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.983096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ae67a-c693-4ffe-8716-669dd21eb196 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:38.985295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.986132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.986406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.986721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.987361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:38.989864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:38.997213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:38.997853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:38.998124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:38.998390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:38.999730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.006525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.030391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 935/1862] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/users => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:39.031351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.048380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d997fd-a593-4c2f-aa78-4ea3faa657ee admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.057020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.057657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.058071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.058353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.059787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.062208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.075238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 928/1863] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:38 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:39.082535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 936/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:39.083498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.086762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.122509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3f0f8-4fe1-4d56-a873-5ec0846ed2bd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.203826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.204473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.204748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.205017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.205743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.209807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.229823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906959-87eb-467c-a3b2-3cafda887904 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.236481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.237321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.237659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.238006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] PATH_INFO: `/v3/projects/e493d577a65a46bb992b8d085e1c8f7b/users/044b5ffdd6f747e99bdf7ff62567209d/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.256395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 937/1865] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:39 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:39.261292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.272974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e493d577a65a46bb992b8d085e1c8f7b, user_id=044b5ffdd6f747e99bdf7ff62567209d, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.281297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.297774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253125-f1b2-4af3-982d-61ee98cb8744 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.306614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 929/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:39 2022] PUT /identity/v3/projects/e493d577a65a46bb992b8d085e1c8f7b/users/044b5ffdd6f747e99bdf7ff62567209d/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:39.312032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.327489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:39.364679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:39.448973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4711ba-b5bd-4447-846b-cbbad0cb3bce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.457765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.458287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.458547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.459121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.459786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.461491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.462090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.462776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.463049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.463324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.464190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.465792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.473555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 938/1867] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:39.479163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.487562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 930/1868] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:39.488699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.501740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5163-591b-4b40-a3f8-d2c8784103ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.504596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b50f0-2281-42dd-90ea-144acdc82403 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.507656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.508756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.509254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.509742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] PATH_INFO: `/v3/projects/e493d577a65a46bb992b8d085e1c8f7b/users/044b5ffdd6f747e99bdf7ff62567209d/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.512881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e493d577a65a46bb992b8d085e1c8f7b, user_id=044b5ffdd6f747e99bdf7ff62567209d, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.516635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd372fa-3434-46cd-ae02-ee5a5f681294 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.517076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.518637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.518934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.519327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] PATH_INFO: `/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3/users/bde8755415fd4759990ed0ad41b6d5ce/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.535343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 931/1869] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:39 2022] PUT /identity/v3/projects/e493d577a65a46bb992b8d085e1c8f7b/users/044b5ffdd6f747e99bdf7ff62567209d/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:39.546388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.546807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.547083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.554118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83a1d17df94cd182915d6ed7a94ec3, user_id=bde8755415fd4759990ed0ad41b6d5ce, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.559143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.587550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 939/1870] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:39 2022] PUT /identity/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3/users/bde8755415fd4759990ed0ad41b6d5ce/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:39.587761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] MFA Rules not processed for user `044b5ffdd6f747e99bdf7ff62567209d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:39.587761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:39.588932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.678219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a26a-38e4-4ca3-ad09-a080173d23b3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.683905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.684932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.685101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.685242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.685899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.687569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.698622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 940/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:39.702577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 932/1872] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:39.703684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.714207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.715784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:39.722393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734c787-62fb-48d8-a39e-7f78e6f809fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.746678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.747639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.748190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.749185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] PATH_INFO: `/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3/users/bde8755415fd4759990ed0ad41b6d5ce/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.752411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83a1d17df94cd182915d6ed7a94ec3, user_id=bde8755415fd4759990ed0ad41b6d5ce, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.756409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e9f1-e5d5-4177-bb81-598980c0d397 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.770568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 941/1873] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:39 2022] PUT /identity/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3/users/bde8755415fd4759990ed0ad41b6d5ce/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:39.784685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.785315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.785964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.790871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b34d9-f606-45ec-b949-39686e17ea7b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.819246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] MFA Rules not processed for user `bde8755415fd4759990ed0ad41b6d5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:39.820615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:39.840222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:39.853619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.854250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.854555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.854784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.908881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:39.917072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 942/1874] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:39.929015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:39.930310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:39.930830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.933176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.943385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55811c-c8ab-4f42-9b63-a9722055e759 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:39.946994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:39.947602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:39.947880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:39.948187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:39.949124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 933/1875] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:39.957916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:39.959407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f179-ea8b-4372-b7bb-f83ac8b57d34 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:39.984277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 943/1876] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:40.014693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:40.024587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8145a-f3bb-4ef2-99e1-98a8fca9159e service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:40.028436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:40.029198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:40.029578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:40.029837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:40.100144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:40.102031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da93f1-d257-42f7-9b94-179e069b52de service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:40.111889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 934/1877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:40.940033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:40.941192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:40.941924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:40.944447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 944/1878] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:22:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:22:40.954628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:40.955211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:40.955211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:40.977451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:40.978681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:41.078642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 935/1879] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:22:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:41.091757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:41.097030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:41.116589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb063b71-6848-402e-9524-52a8aa148eb8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:41.123337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:41.124590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:41.124926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:41.125191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:41.135137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:41.137593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf894a-46ae-41d2-a609-1acced73d19f service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:41.150356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 945/1880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:41.781130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:41.826738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:41.897296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469586-78da-4bfc-8da9-14d675259ca2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:41.908287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:41.909067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:41.909408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:41.909691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] PATH_INFO: `/v3/users/2d9ffa12459841b3bb70f53bb9b7ddab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:41.916122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9ffa12459841b3bb70f53bb9b7ddab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:41.916122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:41.998163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9ffa12459841b3bb70f53bb9b7ddab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:42.010113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9ffa12459841b3bb70f53bb9b7ddab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:42.010873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9ffa12459841b3bb70f53bb9b7ddab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:42.026368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9ffa12459841b3bb70f53bb9b7ddab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:42.067019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9ffa12459841b3bb70f53bb9b7ddab'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:42.079386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 936/1881] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:41 2022] DELETE /identity/v3/users/2d9ffa12459841b3bb70f53bb9b7ddab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:42.081237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:42.082052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:42.082329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:42.104791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:42.106379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:42.220069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 946/1882] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:42.229693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:42.235364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:42.374016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9e335-16a4-4cba-8576-ea8d2535b4b4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:42.379703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:42.381165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:42.381766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:42.382670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:42.415509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:42.420171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:42.447027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 937/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:43.008022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:43.010135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:43.026681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9200-62ad-453b-bc4e-f847470266ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:43.031702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:43.032405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:43.032680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:43.032950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] PATH_INFO: `/v3/projects/4d710a0e7fb34438959e1fb39f707719` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:43.034171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d710a0e7fb34438959e1fb39f707719)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:43.036099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:43.091306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d710a0e7fb34438959e1fb39f707719', 'request_id': 'req-70765f32-1de7-4a80-b3a5-451efc830b1e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.100536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d710a0e7fb34438959e1fb39f707719', 'request_id': 'req-70765f32-1de7-4a80-b3a5-451efc830b1e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.108552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d710a0e7fb34438959e1fb39f707719', 'request_id': 'req-70765f32-1de7-4a80-b3a5-451efc830b1e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.120188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] The token cache is being invalidate because project 4d710a0e7fb34438959e1fb39f707719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:43.120477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.121121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.122668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 947/1884] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:43 2022] DELETE /identity/v3/projects/4d710a0e7fb34438959e1fb39f707719 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:43.127192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:43.137162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e73fff-a6cb-4cc0-9f6a-a0ffd6f82d79 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:43.181707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:43.199887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:43.200485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:43.200766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:43.201042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] PATH_INFO: `/v3/users/bde8755415fd4759990ed0ad41b6d5ce` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:43.202735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde8755415fd4759990ed0ad41b6d5ce)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:43.204684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:43.260896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde8755415fd4759990ed0ad41b6d5ce'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.269427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde8755415fd4759990ed0ad41b6d5ce'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.270042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde8755415fd4759990ed0ad41b6d5ce'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.277492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde8755415fd4759990ed0ad41b6d5ce'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.294169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf00b29a-99d9-44fe-ae33-20051aad6567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde8755415fd4759990ed0ad41b6d5ce'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.304617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 938/1885] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:43 2022] DELETE /identity/v3/users/bde8755415fd4759990ed0ad41b6d5ce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:43.697516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:43.698926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:43.714456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765f32-1de7-4a80-b3a5-451efc830b1e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:43.792302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:43.802783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:43.804144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:43.804412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:43.804689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] PATH_INFO: `/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:43.806100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c83a1d17df94cd182915d6ed7a94ec3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:43.808653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:43.860879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c83a1d17df94cd182915d6ed7a94ec3', 'request_id': 'req-f065ed4a-aec7-474c-86fa-09441d559cda'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.869929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c83a1d17df94cd182915d6ed7a94ec3', 'request_id': 'req-f065ed4a-aec7-474c-86fa-09441d559cda'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.878458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c83a1d17df94cd182915d6ed7a94ec3', 'request_id': 'req-f065ed4a-aec7-474c-86fa-09441d559cda'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.890686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] The token cache is being invalidate because project 8c83a1d17df94cd182915d6ed7a94ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:43.890980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.891642 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f065ed4a-aec7-474c-86fa-09441d559cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:43.893211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 948/1886] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:43 2022] DELETE /identity/v3/projects/8c83a1d17df94cd182915d6ed7a94ec3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:43.898180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:43.898466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:43.898742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:43.921871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:43.923893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:43.991774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 939/1887] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:44.001433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.001749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.002151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.027368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:44.029245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.038539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 949/1888] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:44.038952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.040535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.042740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.055619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f27fd-2cb3-465b-b9e2-e5ded1d3c031 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.056957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708b3c5-0011-4b26-9175-2a26358b3596 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.062693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.063548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.063835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.064135 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] PATH_INFO: `/v3/users/bdfcb7d055eb44a89c7c9de21b893a65` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.065712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfcb7d055eb44a89c7c9de21b893a65)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.066238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.067098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.067692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.068142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.068615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.069238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:44.069498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.071266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.086812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 950/1889] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:22:44.091286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.105887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fcd99-a757-4270-ad88-7482b6ad3d57 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.112164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.113160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.113696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.114219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.115164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.117335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.134544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfcb7d055eb44a89c7c9de21b893a65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:44.144541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfcb7d055eb44a89c7c9de21b893a65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:44.145619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfcb7d055eb44a89c7c9de21b893a65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:44.150897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:44.154704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfcb7d055eb44a89c7c9de21b893a65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:44.169613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 951/1890] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:44.170664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.170997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7340d93f-cf43-4b95-a003-2c48950ec142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfcb7d055eb44a89c7c9de21b893a65'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:44.173138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.179728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 940/1891] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:44 2022] DELETE /identity/v3/users/bdfcb7d055eb44a89c7c9de21b893a65 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:44.184710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.185079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.185430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.209188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:44.210415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.265330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f4d36-2333-4f64-b08e-9e69be5bd618 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.290006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 941/1892] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:44.300492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.302705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.323858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:44.338236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.338869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.339151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.339415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.340090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.342170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.366391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 952/1893] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:44.368295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdef5c-c87b-4672-ad14-8170adb26925 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.370311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.372780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.372933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.373388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.373972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.381410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356a63-f4dc-4ec5-83aa-b98ce11b5ff1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.384521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.386454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.386712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.387338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.387618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.387892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.388668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.390403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.397788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 942/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:44.401603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 953/1895] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:44.405467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.415018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480f86-261a-4b9c-85a5-7c2baa2ce39a service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.419829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.420663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.420940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.421215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.421868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.423510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a74a8-575d-43ea-b420-0edfdc902872 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.438418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 943/1896] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:44.442494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.453851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715b2cb-de25-42ad-b739-7b0d7b726688 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.458812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.459531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.459819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.460127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] PATH_INFO: `/v3/projects/bf5c918e624b46d9a4a592bee3b5073d/users/2b0e40693ca24a1c81bb6ba599a6cbf8/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.476664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5c918e624b46d9a4a592bee3b5073d, user_id=2b0e40693ca24a1c81bb6ba599a6cbf8, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.479617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.503948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 954/1897] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:44 2022] PUT /identity/v3/projects/bf5c918e624b46d9a4a592bee3b5073d/users/2b0e40693ca24a1c81bb6ba599a6cbf8/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:44.514609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.514914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.515273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.548786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] MFA Rules not processed for user `2b0e40693ca24a1c81bb6ba599a6cbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:44.550239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.635640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:44.643578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 944/1898] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:44.648002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.734648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cde427-2b7b-4782-8be2-c84dd9c85278 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.741368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.742130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.742622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.742993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.743830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.745970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.783240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 955/1899] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:44.787321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.801744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:44.804205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8b2f9-7861-40e6-82e0-e133a0831f01 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.806578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:44.909690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.910492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.910777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.911049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.911692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.917424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.922534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a2f69-151b-4982-b49e-0d2cea75f4a6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:44.930755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:44.931474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:44.931755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:44.932103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] PATH_INFO: `/v3/projects/08c87847dec14afd89188c4588d69be7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:44.933551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c87847dec14afd89188c4588d69be7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:44.935510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:44.979765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 945/1900] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:44 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:44.998030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.025564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce963c0-a3b6-4d57-99a4-3c04d766d89a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.045129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.047128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.047271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:45.047779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.049156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.050529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.052771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.073954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c87847dec14afd89188c4588d69be7', 'request_id': 'req-208d6b2e-ab63-4059-ab79-cee63cda5da4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.087484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 946/1901] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:45.089651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c87847dec14afd89188c4588d69be7', 'request_id': 'req-208d6b2e-ab63-4059-ab79-cee63cda5da4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.092094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.104276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c87847dec14afd89188c4588d69be7', 'request_id': 'req-208d6b2e-ab63-4059-ab79-cee63cda5da4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.111491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff0185-d7d3-4920-b9d6-d203cbe5cf6a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.122727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] The token cache is being invalidate because project 08c87847dec14afd89188c4588d69be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:45.124444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.124633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.129883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 956/1902] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:44 2022] DELETE /identity/v3/projects/08c87847dec14afd89188c4588d69be7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:45.130871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.132882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.189941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.190504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.190504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.190689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] PATH_INFO: `/v3/projects/c17c392595164541bc51563ca693986e/users/6861e878c6464b6a9b093c51fbdcaa1a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.206992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17c392595164541bc51563ca693986e, user_id=6861e878c6464b6a9b093c51fbdcaa1a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.210954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.213151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b2e-ab63-4059-ab79-cee63cda5da4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.219872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.220597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.220879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.221155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] PATH_INFO: `/v3/users/044b5ffdd6f747e99bdf7ff62567209d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.224784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=044b5ffdd6f747e99bdf7ff62567209d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.227180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.231078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 947/1903] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:45 2022] PUT /identity/v3/projects/c17c392595164541bc51563ca693986e/users/6861e878c6464b6a9b093c51fbdcaa1a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:45.236386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.243324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.300298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044b5ffdd6f747e99bdf7ff62567209d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.301174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044b5ffdd6f747e99bdf7ff62567209d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.301866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044b5ffdd6f747e99bdf7ff62567209d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.310085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044b5ffdd6f747e99bdf7ff62567209d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.328194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044b5ffdd6f747e99bdf7ff62567209d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.369785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 957/1904] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:45 2022] DELETE /identity/v3/users/044b5ffdd6f747e99bdf7ff62567209d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:45.380441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e957-6f27-43e1-9c3d-09aeb5c7e8dd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.389310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:45.423663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.425863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.479767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:45.507784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.520022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.521946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.523620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.525152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.528426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.537042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f67f9e-291f-4fab-b28a-a21d213669dc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.550377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 948/1905] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:45.553657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.554350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.554624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.554788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.554905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] PATH_INFO: `/v3/users/4a88d80fceb948f7b7cfe4d16d943b4f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.556810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.562774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a88d80fceb948f7b7cfe4d16d943b4f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.564766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.572357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4ce9e-ff26-4414-be4d-b4cbf61d043c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.578792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.579894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.580329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.580726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] PATH_INFO: `/v3/projects/c17c392595164541bc51563ca693986e/users/6861e878c6464b6a9b093c51fbdcaa1a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.583061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17c392595164541bc51563ca693986e, user_id=6861e878c6464b6a9b093c51fbdcaa1a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:45.586094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b2b49-af3e-44ca-bff4-582ff18e25a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:45.608906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 949/1906] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:45 2022] PUT /identity/v3/projects/c17c392595164541bc51563ca693986e/users/6861e878c6464b6a9b093c51fbdcaa1a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:45.612844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.613157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.613420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.666430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] MFA Rules not processed for user `6861e878c6464b6a9b093c51fbdcaa1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:45.670857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.674531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a88d80fceb948f7b7cfe4d16d943b4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.675494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a88d80fceb948f7b7cfe4d16d943b4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.676480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a88d80fceb948f7b7cfe4d16d943b4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.691340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a88d80fceb948f7b7cfe4d16d943b4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.710081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-17fb6b9f-37b5-4898-96b5-31354549d146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a88d80fceb948f7b7cfe4d16d943b4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:45.739161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 958/1907] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:45 2022] DELETE /identity/v3/users/4a88d80fceb948f7b7cfe4d16d943b4f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:45.743209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.743627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.744029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:45.776159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:45.777555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.841483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 950/1908] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:45.852326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.853732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.882907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 959/1909] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:45.904029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:45.906695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:45.916510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636351f-e616-441a-bda1-6943ecd05f46 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:45.954693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:45.988654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:45.989288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:45.989593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:45.989825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:46.000060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4c64-193c-48b6-8fdf-c7ee878e9134 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:46.004651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:46.005540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:46.005913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:46.006278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:46.016554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:46.018132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:46.029228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 960/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:46.112122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:46.114088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:46.127372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 951/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:46.254450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:46.258929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:46.266123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895856f-c32b-497c-82b3-55792f5888ab service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:46.270459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:46.271300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:46.272131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:46.272718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:46.275870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:46.347880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:46.349736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:46.362625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 961/1912] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:46.827028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:46.828727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:46.867077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4767-c721-422e-b649-fbb7df6c5095 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:46.880957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:46.881635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:46.881917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:46.882195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] PATH_INFO: `/v3/projects/a8d83e9950ef4a99b913d0f4a90df468` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:46.883377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d83e9950ef4a99b913d0f4a90df468)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:46.885342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:46.987849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d83e9950ef4a99b913d0f4a90df468', 'request_id': 'req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:46.997065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d83e9950ef4a99b913d0f4a90df468', 'request_id': 'req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.020571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d83e9950ef4a99b913d0f4a90df468', 'request_id': 'req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.041370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] The token cache is being invalidate because project a8d83e9950ef4a99b913d0f4a90df468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:47.041842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.042689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.045210 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 952/1913] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:46 2022] DELETE /identity/v3/projects/a8d83e9950ef4a99b913d0f4a90df468 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:47.049872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:47.069302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326bee6-4979-4128-9675-11567f2a3fa2 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:47.150411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:47.151235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.151613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.152661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] PATH_INFO: `/v3/users/dff5d7ab2d2f4fbeb41ab40614332557` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.154939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff5d7ab2d2f4fbeb41ab40614332557)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:47.157094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:47.217340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff5d7ab2d2f4fbeb41ab40614332557'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.218237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff5d7ab2d2f4fbeb41ab40614332557'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.218906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff5d7ab2d2f4fbeb41ab40614332557'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.226516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff5d7ab2d2f4fbeb41ab40614332557'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.240121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff5d7ab2d2f4fbeb41ab40614332557'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.254515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 962/1914] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:47 2022] DELETE /identity/v3/users/dff5d7ab2d2f4fbeb41ab40614332557 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:47.462935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:47.464845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:47.496474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb74f7-48c7-4c4a-9fb7-49f8da6fbf95 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:47.601615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:47.603363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:47.648017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:47.657880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:47.658551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.658830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.659104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] PATH_INFO: `/v3/projects/e493d577a65a46bb992b8d085e1c8f7b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.661507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e493d577a65a46bb992b8d085e1c8f7b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:47.671888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:47.682936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:47.737151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00773b5-f53e-413c-ac91-9a25c63d48e5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:47.771774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e493d577a65a46bb992b8d085e1c8f7b', 'request_id': 'req-6a35a456-93a3-4b95-af21-2bed07dc33ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.782446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e493d577a65a46bb992b8d085e1c8f7b', 'request_id': 'req-6a35a456-93a3-4b95-af21-2bed07dc33ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.793552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e493d577a65a46bb992b8d085e1c8f7b', 'request_id': 'req-6a35a456-93a3-4b95-af21-2bed07dc33ee'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.809407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:47.810124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.810410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.810685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] PATH_INFO: `/v3/projects/ade32f9ef86642f896717f465dd1a188` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.812204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade32f9ef86642f896717f465dd1a188)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:47.814543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:47.820563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] The token cache is being invalidate because project e493d577a65a46bb992b8d085e1c8f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:47.821070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.822114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6a35a456-93a3-4b95-af21-2bed07dc33ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.824966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 953/1915] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:47 2022] DELETE /identity/v3/projects/e493d577a65a46bb992b8d085e1c8f7b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:47.831702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c991-dbb3-4fec-ac02-343a5dce2502 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.832366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c991-dbb3-4fec-ac02-343a5dce2502 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.832366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9c991-dbb3-4fec-ac02-343a5dce2502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.853705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bad9c991-dbb3-4fec-ac02-343a5dce2502 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:47.855587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bad9c991-dbb3-4fec-ac02-343a5dce2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:47.872739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade32f9ef86642f896717f465dd1a188', 'request_id': 'req-2814985a-f0fb-4e29-9a3f-d92d1eb31166'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.888439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade32f9ef86642f896717f465dd1a188', 'request_id': 'req-2814985a-f0fb-4e29-9a3f-d92d1eb31166'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.895945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade32f9ef86642f896717f465dd1a188', 'request_id': 'req-2814985a-f0fb-4e29-9a3f-d92d1eb31166'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.908972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] The token cache is being invalidate because project ade32f9ef86642f896717f465dd1a188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:47.909625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.910146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2814985a-f0fb-4e29-9a3f-d92d1eb31166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:47.912198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 963/1916] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:47 2022] DELETE /identity/v3/projects/ade32f9ef86642f896717f465dd1a188 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:47.917640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734ed8-72bd-4d26-8747-5d315f2142d5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.918008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734ed8-72bd-4d26-8747-5d315f2142d5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.918330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734ed8-72bd-4d26-8747-5d315f2142d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.952540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 954/1917] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:47.954099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.954383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.954817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:47.970080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-58734ed8-72bd-4d26-8747-5d315f2142d5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:47.971624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-58734ed8-72bd-4d26-8747-5d315f2142d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:47.987449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:47.989620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 964/1918] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:47.995290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:47.996812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:47.997298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:47.997732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.003986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 955/1919] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:48.008276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.021262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b34f6a-8119-441d-91d2-40941a447477 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.026246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.027190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.027482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.027745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.028455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:48.028774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.030826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.039225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:48.040521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:48.048150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 956/1920] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:22:48.049326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.055248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 965/1921] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:48.060182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.073027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43321ba4-1061-409c-90ae-f4783eebfada admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.081172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b37754-dea4-4ebc-a471-008bb0b07270 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.087975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.088531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.088808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.089191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.089996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:48.090306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.090938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.092290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.093305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.094075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.094746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.095674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.097806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.112789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 966/1922] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:48.114660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.127332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348584b6-4246-46a0-967d-9bf89f165083 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.132652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.133579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.133579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.133831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.134450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.137734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.171734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 957/1923] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/projects => generated 409 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:48.174763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.218436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 967/1924] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:48.223489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.239989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:48.285702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:48.303070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaec29e-c522-496e-b04b-2cd5baf90826 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.335612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f989-daad-45d8-b183-a26b21c258f6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.343942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.343942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.343942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.343942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.344820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.347856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.380766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 968/1925] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:48.385463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.399270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.399981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.400256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.400525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.401194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.404137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.407938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef9e05-e420-443d-990c-8f4de3948140 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.414826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.415738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.416138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.416672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.417834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.420059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.433265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 958/1926] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/users => generated 305 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:48.434567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 969/1927] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:48.438953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.439758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.454616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559ee93-f096-4a5a-9c5f-698e71a94743 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.454873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607351c-e246-4532-8a7a-e7aac57380b8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.462045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.463073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.463553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.464063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.465159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.467165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.467322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.467844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.468173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.468445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.469102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.470735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.479995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 970/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:48.482617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 959/1929] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:48.485349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.486980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.497677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edaa8f-a99a-41cc-9fbb-caa2c8f1cf56 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.499838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee243348-585f-4f84-92a4-5ac85b667ac4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.503759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.504503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.504782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.505057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] PATH_INFO: `/v3/projects/03bb7114798545fdbc36c7a41a21a0e7/users/21a8cd4482f343f4875000f0b446b80e/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.511652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.512497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.513007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.513514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.514424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.516824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.524558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bb7114798545fdbc36c7a41a21a0e7, user_id=21a8cd4482f343f4875000f0b446b80e, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.527217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889c94a-7ec8-4c39-bf14-f83f95f2ea7c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.530440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 960/1930] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:48.535290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.542881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 971/1931] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:48 2022] PUT /identity/v3/projects/03bb7114798545fdbc36c7a41a21a0e7/users/21a8cd4482f343f4875000f0b446b80e/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:48.546620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91fcaa-8b70-4f66-b28d-12c7a8cde1a6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.553676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.554102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.554581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.589390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] MFA Rules not processed for user `21a8cd4482f343f4875000f0b446b80e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:48.590700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:48.617343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.618019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.618298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.618579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] PATH_INFO: `/v3/projects/62b4b6edb01f4623aa0efb1c462cda11/users/2643c63c140247e7901ac80cbffb859a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.635093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b4b6edb01f4623aa0efb1c462cda11, user_id=2643c63c140247e7901ac80cbffb859a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.637986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95850a-9e3d-4056-bff1-c930fe7107cf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.657290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 961/1932] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:48 2022] PUT /identity/v3/projects/62b4b6edb01f4623aa0efb1c462cda11/users/2643c63c140247e7901ac80cbffb859a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:48.670428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.671365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.671663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.689486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 972/1933] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:48.702777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.705535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:48.707719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] MFA Rules not processed for user `2643c63c140247e7901ac80cbffb859a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:48.709585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:48.772325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:48.774612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:48.792120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ef60-dea6-4567-8eba-0c8dbc9d6658 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.826386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 962/1934] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:48.827853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:48.883173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.884281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.884750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.885197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.954089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed67c2-52b8-4689-b2c8-8f6d278b3190 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:48.967888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:48.968799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:48.971006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:48.971006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:48.971006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.972940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.981828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:48.983471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:48.996102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 973/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:49.023973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 963/1936] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:48 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:49.026123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.042079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e18eb-69ae-475e-a5b6-2eeeb282ddc6 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.111679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.112927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.113205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.113475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.114103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.116056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.139352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 974/1937] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:49 2022] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:49.143525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.155219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7ec6-b70c-4f2a-96ac-39aeb0ec1aee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.161562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.162199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.162477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.163012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.163670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.165468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.179995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 964/1938] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:49.181146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.191810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75429c6-c18f-4124-ba39-3191c451e35b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.197457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.198141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.198417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.198679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] PATH_INFO: `/v3/projects/a096d3af79934f378d22b642feed9c22/users/354138ccd3604a3894ff264847399944/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.216286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a096d3af79934f378d22b642feed9c22, user_id=354138ccd3604a3894ff264847399944, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.219235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.254989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 975/1939] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:49 2022] PUT /identity/v3/projects/a096d3af79934f378d22b642feed9c22/users/354138ccd3604a3894ff264847399944/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:49.258996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.270069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e2cec-3340-4555-9d33-a5d89d2b9635 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.366473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.367631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.368103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.368517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.369335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.371413 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5dce9-7822-49f4-a776-e49207d94cef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.385434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 965/1940] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:49.389897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.413998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcca5e-454c-4a7a-b69f-2423f8eeee44 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.426023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.426885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.427266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.427639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] PATH_INFO: `/v3/projects/a096d3af79934f378d22b642feed9c22/users/354138ccd3604a3894ff264847399944/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.431773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a096d3af79934f378d22b642feed9c22, user_id=354138ccd3604a3894ff264847399944, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.434643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.468575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 976/1941] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:49 2022] PUT /identity/v3/projects/a096d3af79934f378d22b642feed9c22/users/354138ccd3604a3894ff264847399944/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:49.485127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.485646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.486094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.540280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.542213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.546322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] MFA Rules not processed for user `354138ccd3604a3894ff264847399944`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:49.548036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.550964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:49.604192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:49.644536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988dd28-d6b9-47c8-a710-f4756c5dcd89 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.649832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 966/1942] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:49.656057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.656993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.657403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.657833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] PATH_INFO: `/v3/users/2b0e40693ca24a1c81bb6ba599a6cbf8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.659112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0e40693ca24a1c81bb6ba599a6cbf8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.661394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.661734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.713307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0e40693ca24a1c81bb6ba599a6cbf8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:49.714143 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0e40693ca24a1c81bb6ba599a6cbf8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:49.714780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0e40693ca24a1c81bb6ba599a6cbf8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:49.718986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d174113-0d6f-42f8-9113-f537424b72dd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.722114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0e40693ca24a1c81bb6ba599a6cbf8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:49.722896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.723515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.723822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.724220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.725878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.735427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-432ecb06-2da9-4f9d-85c6-4fa9a4e7ed7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0e40693ca24a1c81bb6ba599a6cbf8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:49.739520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.741786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.750109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 977/1943] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:49 2022] DELETE /identity/v3/users/2b0e40693ca24a1c81bb6ba599a6cbf8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:49.752483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 967/1944] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:49.754807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.755108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.755383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.774363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:49.775588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.842841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 978/1945] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:49.853089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.854656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.915475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc1fd-25a2-4957-a618-a8aa4d529d9e service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.918048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:49.919612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.948236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:49.968239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.969006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.969284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.969734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.981174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:49.982101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d97d3-402b-4dd2-8702-45a7b95dbf69 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:49.982803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:49.985842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:49.986472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:49.986797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:49.987128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:49.988925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:49.992803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 968/1946] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:50.055145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:50.056662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:50.071352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 979/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:50.534197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:50.535868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:50.571141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfbfd5-d3f6-4d58-9511-cf20b31bea80 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:50.576538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:50.577396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:50.577674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:50.577943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] PATH_INFO: `/v3/projects/bf5c918e624b46d9a4a592bee3b5073d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:50.579086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5c918e624b46d9a4a592bee3b5073d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:50.581061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:50.630070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:50.649935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5c918e624b46d9a4a592bee3b5073d', 'request_id': 'req-b19ef928-de7e-4401-9a0f-6c6f78e419c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.659392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5c918e624b46d9a4a592bee3b5073d', 'request_id': 'req-b19ef928-de7e-4401-9a0f-6c6f78e419c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.672197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5c918e624b46d9a4a592bee3b5073d', 'request_id': 'req-b19ef928-de7e-4401-9a0f-6c6f78e419c9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.691741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] The token cache is being invalidate because project bf5c918e624b46d9a4a592bee3b5073d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:50.692155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.693500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.700301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 969/1948] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:50 2022] DELETE /identity/v3/projects/bf5c918e624b46d9a4a592bee3b5073d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:50.702250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:50.714423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6a984-6a8f-4d34-8227-dce4341906a5 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:50.811601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:50.812483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:50.813046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:50.813216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] PATH_INFO: `/v3/users/6861e878c6464b6a9b093c51fbdcaa1a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:50.815763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6861e878c6464b6a9b093c51fbdcaa1a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:50.817574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:50.885631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6861e878c6464b6a9b093c51fbdcaa1a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.886290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6861e878c6464b6a9b093c51fbdcaa1a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.886977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6861e878c6464b6a9b093c51fbdcaa1a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.900280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6861e878c6464b6a9b093c51fbdcaa1a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.914927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c3dd98-c2c9-4524-91c5-d6b08fb9edde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6861e878c6464b6a9b093c51fbdcaa1a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:50.928776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:50.939361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 980/1949] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:50 2022] DELETE /identity/v3/users/6861e878c6464b6a9b093c51fbdcaa1a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:51.241875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:51.244928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:51.273557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef928-de7e-4401-9a0f-6c6f78e419c9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:51.342891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:51.343634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.344042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.344416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] PATH_INFO: `/v3/projects/c17c392595164541bc51563ca693986e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.346151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17c392595164541bc51563ca693986e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:51.348284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:51.412933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17c392595164541bc51563ca693986e', 'request_id': 'req-b215065a-cf48-4606-ab9c-3d26985e551a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:51.419568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17c392595164541bc51563ca693986e', 'request_id': 'req-b215065a-cf48-4606-ab9c-3d26985e551a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:51.429085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17c392595164541bc51563ca693986e', 'request_id': 'req-b215065a-cf48-4606-ab9c-3d26985e551a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:51.447760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] The token cache is being invalidate because project c17c392595164541bc51563ca693986e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:51.448431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:51.449260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b215065a-cf48-4606-ab9c-3d26985e551a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:51.453096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 970/1950] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:51 2022] DELETE /identity/v3/projects/c17c392595164541bc51563ca693986e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:51.457767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.458267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.458618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.486387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:51.488062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:51.559888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 981/1951] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:51.568317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.568608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.568883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.592856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:51.594079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:51.602279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 971/1952] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:51.606654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:51.616343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13598c0-dfa3-46da-8e24-f0916ec57a71 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:51.621753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:51.622374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.622651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.623075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.623727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:51.624062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:51.626031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:51.638529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 982/1953] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:22:51.643283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:51.653528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2aef3-d2db-4181-aade-3952ce5071a6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:51.671281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:51.672059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.672453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.672840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.674121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:51.675955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:51.717222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 972/1954] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:51 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:51.717863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:51.753895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002c63-6e12-4090-874b-8036982a6e7a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:51.916173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:51.917097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.917393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.917667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.920438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:51.924522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:51.965103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 983/1955] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:51 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:51.966914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:51.984122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11ae77-9235-4242-a19b-34d7a2cd6130 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:51.991850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:51.992641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:51.993090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:51.993455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:51.994115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:51.995805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.016428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.023743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 973/1956] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:52.031691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b9d15-2463-43c3-b79c-94b4808a5b6b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.040547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.041452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.041851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.042605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.043537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.046032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8c003-c145-44ee-ab2e-34d59c0ca361 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.064543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.074313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 984/1957] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:52.081101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef506-637e-44dc-9c95-98b5ee572c05 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.088940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.089810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.090189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.090623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] PATH_INFO: `/v3/projects/62bd67a352d547b2af3ed36d189d359c/users/748e4311d1af4afc97871be6edbf583a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.104458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:52.117252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bd67a352d547b2af3ed36d189d359c, user_id=748e4311d1af4afc97871be6edbf583a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.120337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.152925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 974/1958] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:52 2022] PUT /identity/v3/projects/62bd67a352d547b2af3ed36d189d359c/users/748e4311d1af4afc97871be6edbf583a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:52.164513 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.164802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.165102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.207478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] MFA Rules not processed for user `748e4311d1af4afc97871be6edbf583a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:52.208925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:52.296388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:52.313560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 985/1959] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:52.318825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.484735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7235b-dea2-4d60-b26d-a4bdd9aaf343 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.484735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.487080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.487080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.487080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.487453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.492713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.574355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 975/1960] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:52 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:52.578876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.591796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7b959-70b0-4709-8ce3-3b8e8d9a26ec None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.717997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.720804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.721086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.721363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.746172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.755864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.806060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 986/1961] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:52 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:52.811219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.825849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5edd-d0d9-4f6e-abce-c17f8ce0ba01 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.833497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.834156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.834893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.835205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.835864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.837670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.855107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 976/1962] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:52.859888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.876086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e25dc3-da9e-433a-bca2-9f3fb5d7a237 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:52.881473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:52.882112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:52.882392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:52.883520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] PATH_INFO: `/v3/projects/3c8dc64f46574270ba2cd4d953c9a100/users/15b1345a2f4740fd913209f6fec04a35/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:52.907569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8dc64f46574270ba2cd4d953c9a100, user_id=15b1345a2f4740fd913209f6fec04a35, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:52.913343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:52.951768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 987/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:52 2022] PUT /identity/v3/projects/3c8dc64f46574270ba2cd4d953c9a100/users/15b1345a2f4740fd913209f6fec04a35/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:52.956120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:52.985715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332742-7002-4ae4-85d6-7745e171909a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:53.087739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:53.088468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:53.088771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:53.089072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:53.089814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:53.091464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7b281-973f-4ce0-9959-9dd676be89f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:53.103115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 977/1964] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:53.107277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:53.120205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d124c-f2ce-4a8c-b24b-d1a02f1ca983 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:53.129932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:53.131829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:53.132604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:53.133177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] PATH_INFO: `/v3/projects/3c8dc64f46574270ba2cd4d953c9a100/users/15b1345a2f4740fd913209f6fec04a35/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:53.135416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8dc64f46574270ba2cd4d953c9a100, user_id=15b1345a2f4740fd913209f6fec04a35, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:53.138305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:53.151084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 988/1965] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:53 2022] PUT /identity/v3/projects/3c8dc64f46574270ba2cd4d953c9a100/users/15b1345a2f4740fd913209f6fec04a35/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:53.166531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:53.167066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:53.167529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:53.206662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] MFA Rules not processed for user `15b1345a2f4740fd913209f6fec04a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:53.207950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:53.292722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:53.330828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 978/1966] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:53.345087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:53.348672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:53.431746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265713d-95c4-4df0-a60d-92db9d9046c2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:53.435956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:53.436737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:53.436737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:53.437017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:53.447612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:53.449324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1b49-44be-4b4c-b810-8598c1df5cfe service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:53.461049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 989/1967] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:53.837315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:54.010230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260eb90-b9ea-4e44-b432-2e677fdb661b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:54.023798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:54.026000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:54.026372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:54.026741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] PATH_INFO: `/v3/users/748e4311d1af4afc97871be6edbf583a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:54.039092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] RBAC: Authorizing `identity:delete_user(user_id=748e4311d1af4afc97871be6edbf583a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:54.046047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:54.147222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748e4311d1af4afc97871be6edbf583a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.158555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748e4311d1af4afc97871be6edbf583a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.159852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748e4311d1af4afc97871be6edbf583a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.167327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748e4311d1af4afc97871be6edbf583a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.186258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748e4311d1af4afc97871be6edbf583a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.193086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 979/1968] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:53 2022] DELETE /identity/v3/users/748e4311d1af4afc97871be6edbf583a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:54.197573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:54.198460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:54.199017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:54.225660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:54.226964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:54.279644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:54.301867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 990/1969] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:54.311572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:54.313017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:54.373930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce96b-68c1-4e37-85f3-65916d10016d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:54.378207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:54.378923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:54.379207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:54.379483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:54.389339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:54.390912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:54.400899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 980/1970] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:54.700294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:54.701884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:54.713821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570902da-4ca9-4deb-93e8-a25b3d1cb7e4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:54.719183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:54.720121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:54.720466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:54.720840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] PATH_INFO: `/v3/projects/62bd67a352d547b2af3ed36d189d359c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:54.722269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bd67a352d547b2af3ed36d189d359c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:54.730896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:54.810537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bd67a352d547b2af3ed36d189d359c', 'request_id': 'req-82fade36-ad7d-4f6e-8ce6-20894d313ce8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.820090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bd67a352d547b2af3ed36d189d359c', 'request_id': 'req-82fade36-ad7d-4f6e-8ce6-20894d313ce8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.828655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bd67a352d547b2af3ed36d189d359c', 'request_id': 'req-82fade36-ad7d-4f6e-8ce6-20894d313ce8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.844895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] The token cache is being invalidate because project 62bd67a352d547b2af3ed36d189d359c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:54.845186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.845866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:54.848014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 991/1971] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:54 2022] DELETE /identity/v3/projects/62bd67a352d547b2af3ed36d189d359c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:54.852069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:54.859417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:54.863694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2a52-7dc6-4399-a95e-34160d575356 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:54.943573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:54.944310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:54.944593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:54.945005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] PATH_INFO: `/v3/users/15b1345a2f4740fd913209f6fec04a35` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:54.946196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b1345a2f4740fd913209f6fec04a35)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:54.948177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.012660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b1345a2f4740fd913209f6fec04a35'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.024871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b1345a2f4740fd913209f6fec04a35'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.027451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b1345a2f4740fd913209f6fec04a35'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.040015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b1345a2f4740fd913209f6fec04a35'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.058300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b9ece7c4-515a-4fa9-9520-b2a3886d2537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b1345a2f4740fd913209f6fec04a35'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.067662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 981/1972] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:54 2022] DELETE /identity/v3/users/15b1345a2f4740fd913209f6fec04a35 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:55.173542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.176081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.205855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fade36-ad7d-4f6e-8ce6-20894d313ce8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:55.299590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:55.300596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.301068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.301334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] PATH_INFO: `/v3/users/21a8cd4482f343f4875000f0b446b80e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.303035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a8cd4482f343f4875000f0b446b80e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:55.305409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.367624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a8cd4482f343f4875000f0b446b80e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.372836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a8cd4482f343f4875000f0b446b80e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.374437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a8cd4482f343f4875000f0b446b80e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.385275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a8cd4482f343f4875000f0b446b80e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.405083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a8cd4482f343f4875000f0b446b80e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.406832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:55.427598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 992/1973] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:55 2022] DELETE /identity/v3/users/21a8cd4482f343f4875000f0b446b80e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:55.432451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.433453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.433878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.453853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:55.455057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.519211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.521233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.537218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 982/1974] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:55.544768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.546693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.548306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccdba-bfd4-487e-9461-164c086972b1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:55.553946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:55.554783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.555229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.556025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] PATH_INFO: `/v3/projects/3c8dc64f46574270ba2cd4d953c9a100` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.557359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8dc64f46574270ba2cd4d953c9a100)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:55.559795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.577946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:55.623584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd8ace-90e6-4ac2-865a-ba87bc3d7e63 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:55.633000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8dc64f46574270ba2cd4d953c9a100', 'request_id': 'req-dd73790c-d601-439b-bd34-e673660c77b3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.642328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8dc64f46574270ba2cd4d953c9a100', 'request_id': 'req-dd73790c-d601-439b-bd34-e673660c77b3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.650507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8dc64f46574270ba2cd4d953c9a100', 'request_id': 'req-dd73790c-d601-439b-bd34-e673660c77b3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.662022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] The token cache is being invalidate because project 3c8dc64f46574270ba2cd4d953c9a100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:55.662332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.663041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dd73790c-d601-439b-bd34-e673660c77b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:55.664897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 993/1975] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:55 2022] DELETE /identity/v3/projects/3c8dc64f46574270ba2cd4d953c9a100 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:55.670113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591329-5db1-4f10-84cc-a6f18b98f79a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.672387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591329-5db1-4f10-84cc-a6f18b98f79a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.672387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591329-5db1-4f10-84cc-a6f18b98f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.679784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:55.680546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.680800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.681360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.683138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.693536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0d591329-5db1-4f10-84cc-a6f18b98f79a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:55.694723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0d591329-5db1-4f10-84cc-a6f18b98f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.778711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 994/1976] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:55.784322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:55.786504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.786855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.787166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.791607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.815299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 983/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:55.815537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:55.815537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:55.822209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 995/1978] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:55.827078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.838358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0e504-d9d0-479d-96e6-39f65ee1e468 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:55.843946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:55.844570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.844843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.845110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.845813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:55.846113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:55.848338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.863289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 984/1979] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:55.868033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.878437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272009-9871-48b1-9a6d-664fbee96b54 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:55.884282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:55.885190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:55.885555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:55.885840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:55.886493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:55.888645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:55.920682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 996/1980] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:55 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:55.924964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:55.939368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c76ba-8e4d-4091-badd-6db6ec6cc4b7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.005160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.005782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.006089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.006320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.007051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.009094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.044226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 985/1981] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:55 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:56.048670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.062854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6931c-456c-486d-aa97-6d2cfa3ac6d9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.070373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.071060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.071338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.071604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.072635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.074121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.086680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 997/1982] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:56.090431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.102767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.104541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.107779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7656b7-5cc9-4930-b386-f30f3550e8f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.112758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.113437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.113721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.113996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.114649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.116290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.117720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:56.120706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dce8b5-4e2d-4f14-91bd-5630de4795ec admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.128244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.129355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.129484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 986/1983] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:56.129604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.129701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] PATH_INFO: `/v3/users/2643c63c140247e7901ac80cbffb859a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.130902 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2643c63c140247e7901ac80cbffb859a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.133025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.133489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.144370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac9dd2-a560-4b1d-b3a2-f2f473917377 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.149546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.150512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.150639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.151026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] PATH_INFO: `/v3/projects/138d56d029b84d85bc4fead2dfa0f331/users/31c2d5a141b04cc0812166a59f3b9fa7/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.172131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=138d56d029b84d85bc4fead2dfa0f331, user_id=31c2d5a141b04cc0812166a59f3b9fa7, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.174991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.175122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:56.193119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 987/1984] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:56 2022] PUT /identity/v3/projects/138d56d029b84d85bc4fead2dfa0f331/users/31c2d5a141b04cc0812166a59f3b9fa7/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:56.198393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.198949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2643c63c140247e7901ac80cbffb859a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.200239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2643c63c140247e7901ac80cbffb859a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.200489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.201101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2643c63c140247e7901ac80cbffb859a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.213319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2643c63c140247e7901ac80cbffb859a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.228359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-052a589e-5477-487b-8e45-71d76b5c0382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2643c63c140247e7901ac80cbffb859a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.243976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 998/1985] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:56 2022] DELETE /identity/v3/users/2643c63c140247e7901ac80cbffb859a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:56.248946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d84d-2c1e-4045-a38b-6ed05c955b2c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.249271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d84d-2c1e-4045-a38b-6ed05c955b2c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.249597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d84d-2c1e-4045-a38b-6ed05c955b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.268851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8e02d84d-2c1e-4045-a38b-6ed05c955b2c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:56.270076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e02d84d-2c1e-4045-a38b-6ed05c955b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.272603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ca8b-5146-422f-90a0-8c9da81922fe admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.335885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 999/1986] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:56.336908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.337190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.337462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.340350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.341017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.341390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.341714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] PATH_INFO: `/v3/projects/03bb7114798545fdbc36c7a41a21a0e7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.342949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bb7114798545fdbc36c7a41a21a0e7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.344939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.359810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:56.361160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.370086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1000/1987] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:56.370760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.372129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.396993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bb7114798545fdbc36c7a41a21a0e7', 'request_id': 'req-d0b32f51-7c30-437d-a966-8ea3b173828e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.403104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bb7114798545fdbc36c7a41a21a0e7', 'request_id': 'req-d0b32f51-7c30-437d-a966-8ea3b173828e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.411397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bb7114798545fdbc36c7a41a21a0e7', 'request_id': 'req-d0b32f51-7c30-437d-a966-8ea3b173828e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.422324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] The token cache is being invalidate because project 03bb7114798545fdbc36c7a41a21a0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:56.422605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.423251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:56.424865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 988/1988] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:56 2022] DELETE /identity/v3/projects/03bb7114798545fdbc36c7a41a21a0e7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:56.425883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.428093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.437236 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393bf6-06f8-4ba9-83d1-95591d1e3a35 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.444412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:56.493471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.494097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.494375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.494641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.496752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.502589 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b32f51-7c30-437d-a966-8ea3b173828e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.508131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.509273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:56.510039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.510631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.511078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.514840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.573837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.575369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbbb52-1029-46a5-9c2a-b42367c86e86 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.586837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1001/1989] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:56.587966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.588386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.588503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.593461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.594914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52a0ba-0bb0-4fbc-aeda-a7bd4b83ec5b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.606028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 989/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:56.610579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:56.612022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.627813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1002/1991] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:56.635535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.635883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.636278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.659232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:56.661007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:56.669325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 990/1992] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:56.673972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.684386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f95d5-2d27-432b-8835-b5e824a1ee81 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.689300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.689925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.690197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.690445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.691086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:56.691381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.692999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.708925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1003/1993] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:56.710053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.719885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd169e2-83a4-405f-af10-8c7613cb2bbd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.724454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.724948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.725715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.725715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.726214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.728325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.766560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 991/1994] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:56.772751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.783349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694fa1-3b71-452a-b7e8-83d66250a8b8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.844626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.845168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.845448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.845742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.846378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.848337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.870618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1004/1995] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:56 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:56.875372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.886472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e6eb0-0d5f-453a-b452-bcf85a8047d4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.891195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.891803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.892109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.892381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.893072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.894645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.908899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 992/1996] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:56.910769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.925360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b319e-978b-4372-af25-c8dc53019174 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.931649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.932374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.932682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.932850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:56.933502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:56.935290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c789beb-7671-4dc4-9ef6-e52f2eea4b3b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:56.952843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1005/1997] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:56.954451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:56.971671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf77be-10c1-491a-a5af-be4b1eec8b6c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:56.977186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:56.978743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:56.979082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:56.979571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] PATH_INFO: `/v3/projects/d5b5ecc7492849ee8de6c099f02ab2e1/users/40ded6f112c948908dadf6458b681842/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.000527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b5ecc7492849ee8de6c099f02ab2e1, user_id=40ded6f112c948908dadf6458b681842, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.004009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.021032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 993/1998] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:56 2022] PUT /identity/v3/projects/d5b5ecc7492849ee8de6c099f02ab2e1/users/40ded6f112c948908dadf6458b681842/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:57.031812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.032140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.032401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.065216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] MFA Rules not processed for user `40ded6f112c948908dadf6458b681842`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:57.067184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.107953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:57.110334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.139750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:57.157616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1006/1999] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:57.166348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:57.167993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.202725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:57.207881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581d149-6f05-417c-8954-1fe87fa3e142 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:57.225332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:57.227123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.227443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.228326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] PATH_INFO: `/v3/projects/62b4b6edb01f4623aa0efb1c462cda11` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.229923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b4b6edb01f4623aa0efb1c462cda11)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.232061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.275950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e010b-410e-4ee1-b84c-a1c61ae3cd9d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:57.281351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:57.282247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.282543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.282786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.292943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.294852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.305504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1007/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:22:57.307467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b4b6edb01f4623aa0efb1c462cda11', 'request_id': 'req-4c647a9b-5f03-431b-8124-6dd7b4d1a875'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.315598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b4b6edb01f4623aa0efb1c462cda11', 'request_id': 'req-4c647a9b-5f03-431b-8124-6dd7b4d1a875'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.328403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b4b6edb01f4623aa0efb1c462cda11', 'request_id': 'req-4c647a9b-5f03-431b-8124-6dd7b4d1a875'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.333628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:57.345483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] The token cache is being invalidate because project 62b4b6edb01f4623aa0efb1c462cda11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:57.346437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.347017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca1371-d270-488f-89ef-426e2265084e service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:57.347298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.349565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 994/2001] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:57 2022] DELETE /identity/v3/projects/62b4b6edb01f4623aa0efb1c462cda11 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:57.353607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:57.354696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.417665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:57.418317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.418598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.418871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] PATH_INFO: `/v3/users/40ded6f112c948908dadf6458b681842` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.420359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ded6f112c948908dadf6458b681842)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.422355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.440392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647a9b-5f03-431b-8124-6dd7b4d1a875 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:57.446015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:57.446672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.447043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.447375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] PATH_INFO: `/v3/users/354138ccd3604a3894ff264847399944` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.448942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=354138ccd3604a3894ff264847399944)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.451675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.478950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ded6f112c948908dadf6458b681842'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.479692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ded6f112c948908dadf6458b681842'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.480648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ded6f112c948908dadf6458b681842'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.490252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ded6f112c948908dadf6458b681842'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.505533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cae97c57-73c3-46fb-8895-32be94548018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ded6f112c948908dadf6458b681842'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.512597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354138ccd3604a3894ff264847399944'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.521269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1008/2002] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:57 2022] DELETE /identity/v3/users/40ded6f112c948908dadf6458b681842 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:57.521969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354138ccd3604a3894ff264847399944'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.524687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354138ccd3604a3894ff264847399944'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.525860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a516-e68a-4c7f-bd60-0c8449098da2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.526146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a516-e68a-4c7f-bd60-0c8449098da2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.526424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a516-e68a-4c7f-bd60-0c8449098da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.534463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354138ccd3604a3894ff264847399944'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.551391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fca9a516-e68a-4c7f-bd60-0c8449098da2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:57.551391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fca9a516-e68a-4c7f-bd60-0c8449098da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.558180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354138ccd3604a3894ff264847399944'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:57.566046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:57.566252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 995/2003] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:22:57 2022] DELETE /identity/v3/users/354138ccd3604a3894ff264847399944 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:57.634882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1009/2004] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:57.646289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:57.648186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:57.660580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:57.745307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4d4bd-006f-4671-b4c1-696743b3f44f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:57.750389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:57.751741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.752084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.752360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.828096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:57.829771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:57.841081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 996/2005] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:22:57.891864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:57.891864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:57.892199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:57.926451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] MFA Rules not processed for user `31c2d5a141b04cc0812166a59f3b9fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:57.927681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.043978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1010/2006] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:58.046133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.047664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.065907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5371701-357f-41f2-aab4-487e1fd4fc46 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.090297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.091392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.093294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.093582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.094294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.096507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.101318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.104094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.127199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf2be-1b96-4cbb-8d5a-9cb2a4683e59 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.136703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.138170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.139856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.140233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] PATH_INFO: `/v3/projects/a096d3af79934f378d22b642feed9c22` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.141256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 997/2007] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:58.141886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a096d3af79934f378d22b642feed9c22)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.144810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.144953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.257362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bd91-0edc-4e52-a0f8-6f75ef4ff608 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.299286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a096d3af79934f378d22b642feed9c22', 'request_id': 'req-81e4f9cf-321c-424a-920c-326f79dcba17'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.308899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a096d3af79934f378d22b642feed9c22', 'request_id': 'req-81e4f9cf-321c-424a-920c-326f79dcba17'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.321375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a096d3af79934f378d22b642feed9c22', 'request_id': 'req-81e4f9cf-321c-424a-920c-326f79dcba17'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.348683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] The token cache is being invalidate because project a096d3af79934f378d22b642feed9c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:58.348970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.349215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:58.350216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-81e4f9cf-321c-424a-920c-326f79dcba17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.354681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1011/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:58 2022] DELETE /identity/v3/projects/a096d3af79934f378d22b642feed9c22 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:58.360865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556bdc-dd97-4dfb-b4b5-ef2d0f4b6b84 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.361140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556bdc-dd97-4dfb-b4b5-ef2d0f4b6b84 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.361422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556bdc-dd97-4dfb-b4b5-ef2d0f4b6b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.410627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fc556bdc-dd97-4dfb-b4b5-ef2d0f4b6b84 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:58.410627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc556bdc-dd97-4dfb-b4b5-ef2d0f4b6b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.412612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.413446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.414702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.417299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.418160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.421174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.423215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1012/2009] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:58.431555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.431555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.431555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.454051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:58.454595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 998/2010] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:58.455275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.458929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.460584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.468767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1013/2011] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:58.469776 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.473369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c05d7-4087-4d22-8383-7112b1be8b7e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.478920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.479083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93ed67-f8db-4198-9137-992abd4c4c39 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.479722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.480398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.480708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.481460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.483318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.486011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.486637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.486914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.487676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.488395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:58.488702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.490285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.500471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 999/2012] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:58.502068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.508297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1014/2013] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:58.509716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.514484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf05ad-df00-414b-b657-66ae9bb267d2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.517953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:58.522274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.523484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.523961 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.524067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4d0a-5bdf-475a-be29-afc678e526f7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.525145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] PATH_INFO: `/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e/users/f1d9b411a15446f4b3846f07d3a2e8b0/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.538511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.540458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.540747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.541022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.541866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.543758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.554512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cd92e8d9b04dceaf6df38d112ce99e, user_id=f1d9b411a15446f4b3846f07d3a2e8b0, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.558229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.576775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1015/2014] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:58.577098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1000/2015] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:58 2022] PUT /identity/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e/users/f1d9b411a15446f4b3846f07d3a2e8b0/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:58.581025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.581162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.659293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc9ca-5ddf-4d2c-815e-fdc1d2ddb170 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.664149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b8aa5-2482-4403-82fd-33268a4a80d9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.664335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.665008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.665403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.665736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.666427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.668465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.669080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.669941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.670453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.670765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.671478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.673255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.684895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1016/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:22:58.685736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.687386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.694295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1001/2017] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:22:58.694976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.700836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1e2b-86db-43a7-a18e-f822e94dc831 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.704821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714d1e-c973-4bdf-bdf5-6a4dc1fe7521 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.705718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.706346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.706628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.706898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] PATH_INFO: `/v3/projects/d5b5ecc7492849ee8de6c099f02ab2e1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.708038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b5ecc7492849ee8de6c099f02ab2e1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.709480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.709974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.710145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.710423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.710703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] PATH_INFO: `/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e/users/f1d9b411a15446f4b3846f07d3a2e8b0/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.712625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cd92e8d9b04dceaf6df38d112ce99e, user_id=f1d9b411a15446f4b3846f07d3a2e8b0, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.715229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.729796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1002/2018] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:58 2022] PUT /identity/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e/users/f1d9b411a15446f4b3846f07d3a2e8b0/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:58.729796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.767422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b5ecc7492849ee8de6c099f02ab2e1', 'request_id': 'req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.775839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b5ecc7492849ee8de6c099f02ab2e1', 'request_id': 'req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.784372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b5ecc7492849ee8de6c099f02ab2e1', 'request_id': 'req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.798458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] The token cache is being invalidate because project d5b5ecc7492849ee8de6c099f02ab2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:22:58.798827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.799588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e4113b4e-a8bd-41d0-86bf-ab222ac9339e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:22:58.804023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1017/2019] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:22:58 2022] DELETE /identity/v3/projects/d5b5ecc7492849ee8de6c099f02ab2e1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:58.806458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376540d0-e28d-4e81-9d3b-7e6319f4297d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.806931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376540d0-e28d-4e81-9d3b-7e6319f4297d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.807176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376540d0-e28d-4e81-9d3b-7e6319f4297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.819799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b372a3-5ca9-4326-a3a5-d301185fa004 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.831086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-376540d0-e28d-4e81-9d3b-7e6319f4297d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:58.832464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-376540d0-e28d-4e81-9d3b-7e6319f4297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.838469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:58.895994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.896620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.896903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.897166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.897831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.900129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.916262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1018/2020] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:58.919383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.919720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.920081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.929308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1003/2021] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:58.933464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:58.933584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.935962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.948352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:58.949959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:58.958083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152cec-c2ff-4f5a-b22a-b5ca2b339848 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:58.968505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:58.969659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:58.970142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:58.971015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:58.971727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:58.973818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:58.981404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1019/2022] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:58.987676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:58.992361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1004/2023] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:58.996233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.010121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691efbb-6798-480c-b2ba-329302e420fd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.010917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca054647-4ce2-4c27-ad44-f067c77839a8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.016336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.017183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.017471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.017733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] PATH_INFO: `/v3/projects/e4db6d1deb3d4671bab1903102c38085/users/38718b8dbd2b4f29bd867cb52da0c2d1/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.026287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.027266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.028314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.028899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.029766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:22:59.030294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.032380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.036644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4db6d1deb3d4671bab1903102c38085, user_id=38718b8dbd2b4f29bd867cb52da0c2d1, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.039559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc3547-9f95-4622-b4fd-fc70bd0bb1e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.054940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1020/2024] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:22:59.057968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1005/2025] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:58 2022] PUT /identity/v3/projects/e4db6d1deb3d4671bab1903102c38085/users/38718b8dbd2b4f29bd867cb52da0c2d1/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:59.058911 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.073082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.073394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.073630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.077171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b95a-39a0-4cb6-8a0c-e86f1b24de28 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.110105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] MFA Rules not processed for user `38718b8dbd2b4f29bd867cb52da0c2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:59.113804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:59.177801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.178915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.180461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.180813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.181616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.185482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.239358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1021/2026] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:59.240742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.250394 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1006/2027] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:22:59.255556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.277101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07569-770e-446b-8480-0cd23c5a1a67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.323974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedacd67-b4c7-4dd4-8ab4-ef7c8b7d7326 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.329295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.330034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.330413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.330743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.331407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.333537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.377285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1022/2028] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:59.389172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.396958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.397716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.398063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.398420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.399405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.399666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf1312-8c05-44e3-9bf1-2f59c2cc8041 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.402258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.406597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.407217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.407655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.407899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.408595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.410190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.417257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:59.422088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1023/2029] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:59.426170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.434106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1007/2030] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:59.437447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a2ed-6b2f-4ea1-8631-2df85a5c20f9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.438083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.530231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:59.555829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd0b7-d725-442a-ba04-5a1df6f9925a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.558128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.559298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.559582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.559894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.560586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.562197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.578778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.579866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.580274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.580511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.581119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.583234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.585014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1024/2031] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:59.589478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.612663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c1f6-0eaf-49b8-a2af-b141d6fa575b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.617465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1008/2032] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:22:59.622322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.623388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.624120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.624397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.624669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] PATH_INFO: `/v3/projects/8679749bbea74d5394b81ed29800a138/users/bea2a1733f774530a20be55c54bba7b4/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.643338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e899c9-1f1e-4bbd-ae14-77f2e171d3c8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.643887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8679749bbea74d5394b81ed29800a138, user_id=bea2a1733f774530a20be55c54bba7b4, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.646793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485087f-a106-4e43-bf64-5e1fd4043265 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.652191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.653496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.654582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.654936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.655994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.658266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.663346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1025/2033] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:59 2022] PUT /identity/v3/projects/8679749bbea74d5394b81ed29800a138/users/bea2a1733f774530a20be55c54bba7b4/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:22:59.674586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531777-d89f-47ac-b193-604edfce9194 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.674867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531777-d89f-47ac-b193-604edfce9194 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.675133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531777-d89f-47ac-b193-604edfce9194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.680078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1009/2034] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:59.682985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.694782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b0179-6a11-4ab7-b413-cdfd72becc25 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.709722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-af531777-d89f-47ac-b193-604edfce9194 None None] MFA Rules not processed for user `bea2a1733f774530a20be55c54bba7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:22:59.710982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-af531777-d89f-47ac-b193-604edfce9194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:59.779798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.779798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.780284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.780374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] PATH_INFO: `/v3/projects/3b0b8d8106ba434682e95c250e623f09/users/939943ae30e9453dae02049e708e8ad8/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.808489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0b8d8106ba434682e95c250e623f09, user_id=939943ae30e9453dae02049e708e8ad8, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.812693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.836767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1010/2035] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:59 2022] PUT /identity/v3/projects/3b0b8d8106ba434682e95c250e623f09/users/939943ae30e9453dae02049e708e8ad8/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:22:59.837707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.855497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1026/2036] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:22:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:22:59.856661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531777-d89f-47ac-b193-604edfce9194 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.858330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-af531777-d89f-47ac-b193-604edfce9194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:22:59.918425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:22:59.924061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e899f3-f7d9-41ad-bcfa-22c5f879c708 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.930915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:22:59.931753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:22:59.932159 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:22:59.932932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:22:59.933694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:22:59.937116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:22:59.951594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1011/2037] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:22:59.957245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:22:59.966797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531777-d89f-47ac-b193-604edfce9194 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:22:59.993687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1736ca-efce-4c82-9c97-ee832711dd3b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:00.006409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:00.007380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.008205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.008486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] PATH_INFO: `/v3/projects/3b0b8d8106ba434682e95c250e623f09/users/939943ae30e9453dae02049e708e8ad8/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.010989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0b8d8106ba434682e95c250e623f09, user_id=939943ae30e9453dae02049e708e8ad8, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:00.015146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5254-e12f-45b4-8e2d-86c47b22450b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:00.031369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1012/2038] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:22:59 2022] PUT /identity/v3/projects/3b0b8d8106ba434682e95c250e623f09/users/939943ae30e9453dae02049e708e8ad8/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:00.032715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600950d9-42b3-424f-acaa-1806de511e3c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.033000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600950d9-42b3-424f-acaa-1806de511e3c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.033273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600950d9-42b3-424f-acaa-1806de511e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.052656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:00.053786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.054310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.055354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.066575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-600950d9-42b3-424f-acaa-1806de511e3c None None] MFA Rules not processed for user `f1d9b411a15446f4b3846f07d3a2e8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:00.067720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-600950d9-42b3-424f-acaa-1806de511e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.083015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:00.148748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:00.152352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf0f76-2f38-4dad-98d0-7ca608bae712 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:00.167338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1013/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:00.178177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.178177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.178177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.182043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1027/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:22:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:00.183752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696945-057a-4b00-807c-be9252e536bc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.184073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696945-057a-4b00-807c-be9252e536bc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.185491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696945-057a-4b00-807c-be9252e536bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.212678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] MFA Rules not processed for user `939943ae30e9453dae02049e708e8ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:00.213985 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.223479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a8696945-057a-4b00-807c-be9252e536bc None None] MFA Rules not processed for user `31c2d5a141b04cc0812166a59f3b9fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:00.224721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a8696945-057a-4b00-807c-be9252e536bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.300467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1014/2041] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:00.310733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1028/2042] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:00.312927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:00.314442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.324300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696945-057a-4b00-807c-be9252e536bc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:00.325929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a8696945-057a-4b00-807c-be9252e536bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.387130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:00.391416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c48-7212-4676-af9c-6446819b9aa8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:00.397188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:00.397821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.398444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.398940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.440718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696945-057a-4b00-807c-be9252e536bc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:00.447579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:00.448446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:00.448724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:00.448996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:00.452042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:00.473940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:00.478309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f91c-2f48-4678-8391-51c8d30242ea service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:00.483537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:00.485667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:00.494355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1029/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:00.496739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1015/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:02.815428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:02.815894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:02.816007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:02.840371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] MFA Rules not processed for user `bea2a1733f774530a20be55c54bba7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:02.841703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:02.886864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:02.898786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1030/2045] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:05.314302 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:05.323620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f034f2-ca46-4b1b-a069-fbaacd1bba72 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:05.331105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:05.332043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:05.332537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:05.332995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:05.345222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:05.346975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cf43-8684-4129-95e0-61ae51a8ad4b service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:05.358358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1016/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:10.512305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:10.597509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7604e-a9e4-43b4-b077-670518d4ab24 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:10.602397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:10.603152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:10.603522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:10.603885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] PATH_INFO: `/v3/users/38718b8dbd2b4f29bd867cb52da0c2d1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:10.605591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38718b8dbd2b4f29bd867cb52da0c2d1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:10.607598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:10.661548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38718b8dbd2b4f29bd867cb52da0c2d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:10.662449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38718b8dbd2b4f29bd867cb52da0c2d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:10.663257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38718b8dbd2b4f29bd867cb52da0c2d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:10.671225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38718b8dbd2b4f29bd867cb52da0c2d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:10.690063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38718b8dbd2b4f29bd867cb52da0c2d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:10.707844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1031/2047] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:23:10 2022] DELETE /identity/v3/users/38718b8dbd2b4f29bd867cb52da0c2d1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:10.712602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:10.713116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:10.713207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:10.750431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:10.751642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:10.814654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1017/2048] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:10.824509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:10.826188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:10.887146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ff43-2b5d-4780-ad2d-6fe94559f96c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:10.891727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:10.892567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:10.892777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:10.893151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:10.904466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:10.906017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:10.916748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1032/2049] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:23:11.272537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:11.275532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:11.301290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bc6ee-b705-4129-9f70-9e29e860d871 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:11.306971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:11.307756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:11.308165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:11.308661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] PATH_INFO: `/v3/projects/e4db6d1deb3d4671bab1903102c38085` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:11.311396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4db6d1deb3d4671bab1903102c38085)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:11.313966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:11.412261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4db6d1deb3d4671bab1903102c38085', 'request_id': 'req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.436167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4db6d1deb3d4671bab1903102c38085', 'request_id': 'req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.440459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4db6d1deb3d4671bab1903102c38085', 'request_id': 'req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.459502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] The token cache is being invalidate because project e4db6d1deb3d4671bab1903102c38085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:23:11.459827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.460494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.464818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1018/2050] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:23:11 2022] DELETE /identity/v3/projects/e4db6d1deb3d4671bab1903102c38085 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:11.466218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:11.476516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9556c-c3e7-41c6-9b31-caaa863743a7 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:11.489586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:11.555832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:11.557908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:11.558192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:11.558469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] PATH_INFO: `/v3/users/939943ae30e9453dae02049e708e8ad8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:11.564637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=939943ae30e9453dae02049e708e8ad8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:11.566566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:11.636378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939943ae30e9453dae02049e708e8ad8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.637312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939943ae30e9453dae02049e708e8ad8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.638061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939943ae30e9453dae02049e708e8ad8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.648161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939943ae30e9453dae02049e708e8ad8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.666779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-116420b7-f4df-4718-83f6-69f00ac70cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939943ae30e9453dae02049e708e8ad8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:11.682904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1033/2051] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:23:11 2022] DELETE /identity/v3/users/939943ae30e9453dae02049e708e8ad8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:12.027481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.030009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:12.046809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f7ab-ffa6-4c2b-93fa-a04cd3515ea1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.057688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:12.119684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.120390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.120670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.120943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] PATH_INFO: `/v3/projects/3b0b8d8106ba434682e95c250e623f09` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.122324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0b8d8106ba434682e95c250e623f09)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.124682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.184923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0b8d8106ba434682e95c250e623f09', 'request_id': 'req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:12.191448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0b8d8106ba434682e95c250e623f09', 'request_id': 'req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:12.203020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0b8d8106ba434682e95c250e623f09', 'request_id': 'req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:12.214850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] The token cache is being invalidate because project 3b0b8d8106ba434682e95c250e623f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:23:12.215104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:12.216601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f430e9f2-1bdf-499c-a544-9c0de2a0ca53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:12.218956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1019/2052] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:23:12 2022] DELETE /identity/v3/projects/3b0b8d8106ba434682e95c250e623f09 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:12.225989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.226274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.226545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.249665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:12.251044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:12.319781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1034/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:12.329358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.329647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.330017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.352736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:12.353963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:12.366766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1020/2054] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:12.368229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.379964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebeda-7b39-4f85-bab8-9ed22750e3c2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.384446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.385066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.385342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.385743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.386478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:23:12.386771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.389674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.407160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1035/2055] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:23:12.411709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.425004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5857396-bced-48a9-bbdb-4b1207e63615 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.433905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.435608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.436024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.436487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.437218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.439375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.487484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1021/2056] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:23:12 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:23:12.488797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.508170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58efb65-56eb-4d86-9673-e1c4274970fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.542751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:12.644469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.648701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.653746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.654278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.655156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.657758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.693281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1036/2057] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:23:12 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:12.697409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.713736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab5c2-edd9-436a-9171-9407908dbe0f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.718878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.719507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.719815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.720123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.720778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.722458 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.746861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1022/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:23:12.747077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.770777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4b66e-6c71-46b0-bc16-f64f7b59a0dc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.777311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.778333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.779110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.779611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.780560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.782472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb2d0a-681e-4790-87d0-99bef16048cb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.812231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:12.821329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1037/2059] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:23:12.826574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbda9d-d6fa-4976-a8f1-1890c4af71ff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:12.833318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:12.834225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.834658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.835259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] PATH_INFO: `/v3/projects/b32ad15286cb4b6885423ef7407c26a3/users/d39ec2b57cd54328b482a9d279173f40/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.868764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32ad15286cb4b6885423ef7407c26a3, user_id=d39ec2b57cd54328b482a9d279173f40, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:12.877874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:12.918666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1023/2060] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:12 2022] PUT /identity/v3/projects/b32ad15286cb4b6885423ef7407c26a3/users/d39ec2b57cd54328b482a9d279173f40/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:12.930098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:12.930379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:12.930653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:12.959200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] MFA Rules not processed for user `d39ec2b57cd54328b482a9d279173f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:12.960475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:13.038993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1038/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:13.051254 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:13.053041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:13.100605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:13.119536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172576-23ff-4732-b246-0e3be4cd44da admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:13.124877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:13.125054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:13.125334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:13.125604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:13.137835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:13.139350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ef2c4-995f-4d11-9acb-9dc1d0b73920 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:13.149214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1024/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:23:15.818326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:15.883640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5c4e1-06f9-4d63-af62-27a3374a0a4c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:15.889616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:15.890289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:15.890715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:15.890995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] PATH_INFO: `/v3/users/d39ec2b57cd54328b482a9d279173f40` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:15.892511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39ec2b57cd54328b482a9d279173f40)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:15.894553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:15.936832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:15.959287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39ec2b57cd54328b482a9d279173f40'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:15.960165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39ec2b57cd54328b482a9d279173f40'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:15.960905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39ec2b57cd54328b482a9d279173f40'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:15.970365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39ec2b57cd54328b482a9d279173f40'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:15.983043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39ec2b57cd54328b482a9d279173f40'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.000226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1039/2063] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:23:15 2022] DELETE /identity/v3/users/d39ec2b57cd54328b482a9d279173f40 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:16.004570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.005040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.005123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.044912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:16.046281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:16.109267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1025/2064] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:16.119337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:16.120846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:16.194158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fcb0-9f0e-435e-851d-df53c67447ea admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:16.197995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:16.198612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.198896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.199266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.209003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:16.210516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9cfe5-799f-45c2-a191-73f8130870be service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:16.220701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1040/2065] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:23:16.671329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:16.672901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:16.694910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64d52-9e2f-4a9e-a7a7-1f0c12165685 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:16.701142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:16.701866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.702376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.702716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] PATH_INFO: `/v3/projects/b32ad15286cb4b6885423ef7407c26a3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.704859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32ad15286cb4b6885423ef7407c26a3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:16.707880 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:16.762106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32ad15286cb4b6885423ef7407c26a3', 'request_id': 'req-abc664c4-2547-406d-853a-893d265320f3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.768289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32ad15286cb4b6885423ef7407c26a3', 'request_id': 'req-abc664c4-2547-406d-853a-893d265320f3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.777840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32ad15286cb4b6885423ef7407c26a3', 'request_id': 'req-abc664c4-2547-406d-853a-893d265320f3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.789290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] The token cache is being invalidate because project b32ad15286cb4b6885423ef7407c26a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:23:16.789734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.790421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-abc664c4-2547-406d-853a-893d265320f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:16.792021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1026/2066] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:23:16 2022] DELETE /identity/v3/projects/b32ad15286cb4b6885423ef7407c26a3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:16.797384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.797667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.797987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.825405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:16.826629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:16.889060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1041/2067] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:16.896933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c475270-a988-4f8a-989a-821dea870222 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.897292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c475270-a988-4f8a-989a-821dea870222 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.897650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c475270-a988-4f8a-989a-821dea870222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.917192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8c475270-a988-4f8a-989a-821dea870222 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:16.918509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8c475270-a988-4f8a-989a-821dea870222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:16.926672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1027/2068] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:16.930996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:16.940961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa9450-cd66-408a-8baf-43c08cf62959 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:16.945613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:16.946215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.946488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.946763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.947406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:23:16.947702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:16.949469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:16.961036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1042/2069] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:23:16.965444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c475270-a988-4f8a-989a-821dea870222 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:16.974586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c475270-a988-4f8a-989a-821dea870222 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:16.979204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:16.979797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:16.980107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:16.980479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:16.981095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:16.982982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.014510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1028/2070] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:23:16 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:17.015837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:17.027998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6d30-78ca-4bb0-8b47-87fcc19a43ea admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:17.070664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:17.095525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:17.096335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.096704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.097065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.097824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:17.100087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.125266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1043/2071] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:23:17 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:23:17.129366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:17.146129 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff457eec-4f08-4436-b7a0-68b3127a605d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:17.151146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:17.151781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.152092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.152418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.153258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:17.155029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.168256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1029/2072] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:23:17.172367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:17.183950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c75bd-5681-4886-80f3-e645f91b6040 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:17.189178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:17.189857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.190228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.190600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.191352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:17.193106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de81f3-dc21-47aa-8fb6-2d580f1392de admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.212287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1044/2073] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:23:17.222057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:17.239139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd32a9-fa5c-4b08-b68c-8abb91b31b24 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:17.244539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:17.245203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.245476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.245745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] PATH_INFO: `/v3/projects/d07bc10178c14c159ae661fa4e887a0b/users/1f33a883115442b4a65677cbd1026525/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.263664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07bc10178c14c159ae661fa4e887a0b, user_id=1f33a883115442b4a65677cbd1026525, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:17.266684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.281962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1030/2074] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:17 2022] PUT /identity/v3/projects/d07bc10178c14c159ae661fa4e887a0b/users/1f33a883115442b4a65677cbd1026525/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:17.286993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07323c6-958f-4450-82f2-1ca7c081ea16 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.287336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07323c6-958f-4450-82f2-1ca7c081ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.287541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07323c6-958f-4450-82f2-1ca7c081ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.306804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a07323c6-958f-4450-82f2-1ca7c081ea16 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:17.308041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a07323c6-958f-4450-82f2-1ca7c081ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:17.372450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1045/2075] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:17.384736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:17.387777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:17.397380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:17.460770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31072-3eff-4ff1-aeec-411a8e8423d6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:17.464464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:17.465157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:17.465431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:17.465698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:17.480511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:17.482874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:17.498283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1031/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:18.345982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47634-9037-4903-ae3c-ece22200da6a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:18.346887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47634-9037-4903-ae3c-ece22200da6a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:18.347350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47634-9037-4903-ae3c-ece22200da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:18.381494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0cb47634-9037-4903-ae3c-ece22200da6a None None] MFA Rules not processed for user `1f33a883115442b4a65677cbd1026525`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:18.384369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0cb47634-9037-4903-ae3c-ece22200da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:18.477346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1046/2077] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:18.489477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:18.491542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:18.559558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764c1f2-2d89-4305-bad4-83f0e3910f18 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:18.563365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:18.564097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:18.564448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:18.564789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:18.573689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:18.575884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63be68a-070c-47f2-8c0b-7f50cb042310 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:18.585172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1032/2078] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:20.081784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88d5f-6e3f-4bc8-a63c-e2b307f6ce3d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:20.082799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88d5f-6e3f-4bc8-a63c-e2b307f6ce3d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:20.083142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c88d5f-6e3f-4bc8-a63c-e2b307f6ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:20.102304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f7c88d5f-6e3f-4bc8-a63c-e2b307f6ce3d None None] MFA Rules not processed for user `1f33a883115442b4a65677cbd1026525`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:20.103727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f7c88d5f-6e3f-4bc8-a63c-e2b307f6ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:20.116097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1047/2079] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:20.937270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:20.937723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:20.937820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:20.939480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1033/2080] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:23:20.954592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:20.955197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:20.955536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:20.980363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] MFA Rules not processed for user `e843df35ed704a3db7b73ee7678cb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:20.982471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:21.032425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:21.077956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1048/2081] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:21.080439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:21.082316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:21.088839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:21.091267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:21.098841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa6cc-3b6b-4dfe-a25b-0c1acbac4c8f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:21.103317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:21.103980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.104260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.104542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] PATH_INFO: `/v3/users/652575a6004a45db9b7db7a9a36aca4a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.104648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db0bdc-dcb1-42a9-b121-edc4cd9f158d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:21.105698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=652575a6004a45db9b7db7a9a36aca4a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:21.107618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:21.109820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:21.110527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.110800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.111070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.120823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:21.122903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:21.135182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1049/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:21.182001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652575a6004a45db9b7db7a9a36aca4a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.190367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652575a6004a45db9b7db7a9a36aca4a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.191022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652575a6004a45db9b7db7a9a36aca4a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.199456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652575a6004a45db9b7db7a9a36aca4a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.214918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d4624abf-de8e-4aca-8147-944a0b6670ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652575a6004a45db9b7db7a9a36aca4a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.221874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1034/2083] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:23:21 2022] DELETE /identity/v3/users/652575a6004a45db9b7db7a9a36aca4a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:21.441522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:21.453232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06cfa-464b-43fb-9957-4d15669facf8 service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:21.550267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:21.552178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.552460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.552712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] PATH_INFO: `/v3/projects/242836f9e47f4afbbc3f70c14eebc846` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.554032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242836f9e47f4afbbc3f70c14eebc846)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:21.556057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:21.634181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242836f9e47f4afbbc3f70c14eebc846', 'request_id': 'req-2a1a12d7-54b9-44c6-8613-40ac47cab861'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.648280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242836f9e47f4afbbc3f70c14eebc846', 'request_id': 'req-2a1a12d7-54b9-44c6-8613-40ac47cab861'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.661591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242836f9e47f4afbbc3f70c14eebc846', 'request_id': 'req-2a1a12d7-54b9-44c6-8613-40ac47cab861'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.682155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] The token cache is being invalidate because project 242836f9e47f4afbbc3f70c14eebc846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:23:21.682675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.683898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2a1a12d7-54b9-44c6-8613-40ac47cab861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:21.690370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1050/2084] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:23:21 2022] DELETE /identity/v3/projects/242836f9e47f4afbbc3f70c14eebc846 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:21.691311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.691831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.692629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.721003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:21.722251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:21.749022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:21.848241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1035/2085] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:21.856412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.856703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.856981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.884509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:21.885738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:21.897479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1051/2086] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:21.901984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:21.912976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d31335-8538-406a-b502-7992ea7bcb32 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:21.920817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:21.921500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.921978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.922349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.922971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:23:21.923319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:21.925598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:21.947089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:21.956011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1036/2087] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:23:21.960757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c8978-2309-4805-b0f1-df42a4ca60b6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:21.965750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:21.967265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:21.972030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:21.972463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:21.973452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:21.975275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff1e30-059c-4275-99e6-c368773327db admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.029009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1052/2088] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:23:21 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:22.029709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:22.040797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eefb5-e722-4789-8ab9-0cf6b3f5373e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:22.112738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:22.115811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.116132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.116745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.131973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:22.131973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.138373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a1eb-0674-4346-a6ac-5d8f93ae3835 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.138994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a1eb-0674-4346-a6ac-5d8f93ae3835 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.138994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a1eb-0674-4346-a6ac-5d8f93ae3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.154262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1037/2089] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:23:22 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:22.157481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:22.168869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9422873-17ab-41bf-9bb0-4fab739cda41 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:22.173850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:22.174252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.174531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.174799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.175347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1cf7a1eb-0674-4346-a6ac-5d8f93ae3835 None None] MFA Rules not processed for user `fd037159ae114915a68ad4f97cd5b92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:22.175466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:22.177112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.178942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1cf7a1eb-0674-4346-a6ac-5d8f93ae3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:22.189332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1038/2090] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:23:22.193471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:22.204329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff5896-01af-4595-ae36-7a414ff3227d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:22.215884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:22.223115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:22.223796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.224074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.224354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.225001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:22.226962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.244931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1039/2091] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:23:22.249731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:22.265583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd591d7-0eaa-4a03-9f3b-79a5717090cb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:22.272963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:22.274670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.274888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.275158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] PATH_INFO: `/v3/projects/98a79cc00fe94102938bd8955b3903d3/users/5305d254a2eb47ec932088b7d75129a3/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.296761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a79cc00fe94102938bd8955b3903d3, user_id=5305d254a2eb47ec932088b7d75129a3, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:22.297712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.304443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1053/2092] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:22.334709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1040/2093] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:22 2022] PUT /identity/v3/projects/98a79cc00fe94102938bd8955b3903d3/users/5305d254a2eb47ec932088b7d75129a3/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:22.340644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.341134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.341639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.381645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:22.384402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:22.492933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1054/2094] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:22.534073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:22.536140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:22.664082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9bd3-851c-411e-8232-46359ae1843e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:22.668186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:22.669093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:22.669472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:22.670387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:22.680482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:22.685553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:22.687533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc768b-5633-4588-8f23-2dbcfe1b47af service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:22.699576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1041/2095] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:30.366497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:30.373379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:30.444086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037578-7b55-4c94-8eea-f57612aef820 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:30.447691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:30.448538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:30.448994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:30.449267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:30.451244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:30.475949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473dfef-0769-4674-8b80-88faf48c477a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:30.476435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473dfef-0769-4674-8b80-88faf48c477a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:30.476525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473dfef-0769-4674-8b80-88faf48c477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:30.507596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1473dfef-0769-4674-8b80-88faf48c477a None None] MFA Rules not processed for user `5305d254a2eb47ec932088b7d75129a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:30.508835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1473dfef-0769-4674-8b80-88faf48c477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:30.532290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:30.533656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:30.544935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1055/2096] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:30.578889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1042/2097] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:30.593537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:30.594919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:30.632544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:30.700364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad11f2-127b-4950-a24a-20066607ad05 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:30.705985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:30.706595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:30.706868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:30.707136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:30.716660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:30.718230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ecbce-2c0b-4b9b-a701-f917c16d6abd service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:30.731812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1056/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:23:32.731984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:32.732840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:32.733520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:32.763078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] MFA Rules not processed for user `5305d254a2eb47ec932088b7d75129a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:32.764703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:32.797702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1043/2099] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:40.723851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=24 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:42.755727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=38 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:45.518423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990ad4-a768-4169-a61a-3dd05fd1593d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:45.519271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990ad4-a768-4169-a61a-3dd05fd1593d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:45.519708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990ad4-a768-4169-a61a-3dd05fd1593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:45.542829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b2990ad4-a768-4169-a61a-3dd05fd1593d None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:45.544442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b2990ad4-a768-4169-a61a-3dd05fd1593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:45.634496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1057/2100] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:23:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:45.688711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:45.690269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:45.770131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6c2c7-19b4-4eb7-bd7f-f3fe11e8c4d4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:45.776069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:45.776762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:45.777112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:45.777389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:45.786425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:45.788028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:45.798106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1044/2101] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:46.388200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b79ef-5bbc-45a6-abb0-50c604440d62 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:46.388492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b79ef-5bbc-45a6-abb0-50c604440d62 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:46.388773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b79ef-5bbc-45a6-abb0-50c604440d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:46.409377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-835b79ef-5bbc-45a6-abb0-50c604440d62 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:46.410705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-835b79ef-5bbc-45a6-abb0-50c604440d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:46.419818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1058/2102] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:23:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:46.432910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:46.444337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509fcc5-5e98-47f6-8c36-15a08a454c12 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:46.450486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:46.451218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:46.451507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:46.451874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:46.461111 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:46.462802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:46.474168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1045/2103] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:46.847113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f979-5006-484a-8e84-15a5aba70970 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:46.848154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f979-5006-484a-8e84-15a5aba70970 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:46.848698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f979-5006-484a-8e84-15a5aba70970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:46.878379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0e32f979-5006-484a-8e84-15a5aba70970 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:46.879637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e32f979-5006-484a-8e84-15a5aba70970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:46.887879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1059/2104] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:23:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:46.901525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:46.913275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175afdf-f3e9-4ef2-8a4b-01ca16effccf service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:46.920543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:46.921142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:46.921415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:46.921687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:46.930651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:46.932604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:46.941370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1046/2105] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:47.342804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:47.343087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:47.343424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:47.366953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:47.368174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:47.376053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1060/2106] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:23:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:47.389673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:47.400386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09931722-47d2-4e9f-a30d-22961dfbc720 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:47.405408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:47.406006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:47.406284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:47.406555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:47.414755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:47.416559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e18fa-ae42-4a1e-bb80-2a7756ad95ea service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:47.424975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1047/2107] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:23:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:23:49.655089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:49.656870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:49.677970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbbd56-7eb4-45b7-ac53-e0c09505a8a9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:49.684188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:49.684907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:49.685185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:49.685437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] PATH_INFO: `/v3/users/bea2a1733f774530a20be55c54bba7b4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:49.686682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea2a1733f774530a20be55c54bba7b4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:49.691433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:49.772065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea2a1733f774530a20be55c54bba7b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:49.773144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea2a1733f774530a20be55c54bba7b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:49.773851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea2a1733f774530a20be55c54bba7b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:49.783670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea2a1733f774530a20be55c54bba7b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:49.803784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea2a1733f774530a20be55c54bba7b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:49.822416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1061/2108] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:23:49 2022] DELETE /identity/v3/users/bea2a1733f774530a20be55c54bba7b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:49.827723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:49.828616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:49.828616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:49.854350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:49.855727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:49.937046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1048/2109] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:23:49.950220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:49.952481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:50.031629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cef90-d59b-4bf8-82a7-2a0e8ee7cfbf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.035942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.036662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.037006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.037352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.052328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.053766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1392-519e-4b3c-8ced-3adfee46e4c6 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.063583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:50.068432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1062/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:50.256427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.257864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:50.270100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6cd3d-b30e-4e9d-bfd4-6ea946aeec0f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.275132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.275786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.276077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.276348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] PATH_INFO: `/v3/projects/8679749bbea74d5394b81ed29800a138` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.277682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8679749bbea74d5394b81ed29800a138)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.279602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.325605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:50.328971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8679749bbea74d5394b81ed29800a138', 'request_id': 'req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:50.335867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8679749bbea74d5394b81ed29800a138', 'request_id': 'req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:50.343492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8679749bbea74d5394b81ed29800a138', 'request_id': 'req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:50.354217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] The token cache is being invalidate because project 8679749bbea74d5394b81ed29800a138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:23:50.354561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:50.355243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bb64006e-73fe-47ef-b6b4-2cfd32d29f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:23:50.356804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1049/2111] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:23:50 2022] DELETE /identity/v3/projects/8679749bbea74d5394b81ed29800a138 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:23:50.361869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.362158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.362433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.384635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:50.385934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:50.464801 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1063/2112] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:50.467351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.467669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.468028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.499114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:50.500388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:50.509554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1050/2113] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:50.513749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.526806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3bad-d607-42df-bf52-9fad2e68cdbc None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.529860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.530690 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.530927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.531272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.532123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:23:50.532429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.534087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.548897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1064/2114] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:23:50.554001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.564155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73226026-4437-49e1-9aad-06ce48e56966 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.569017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.573146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.573652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.575175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.575175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.577110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.610960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1051/2115] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:23:50 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:50.621353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.635580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a412-6833-4adc-94d8-25f6f6dc6a97 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.729607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.730366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.730796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.730882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.731583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.734750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.762764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1065/2116] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:23:50 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:23:50.767216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.780430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5b6a5-34ed-441a-b60c-44283e7fb386 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.786690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.788092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.788393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.788750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.789434 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.791525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.814531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1052/2117] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:23:50.818799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.831431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4cf8-ecb8-4e78-97d7-4299e57aebf6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.838624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.839463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.839886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.840247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.841130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.842997 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf40d-2839-46a6-abfb-ff3ec3ecc174 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.861839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1066/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:23:50.863659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:50.874982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaca05-4261-4e6a-8393-6247512e6699 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:50.880721 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:50.881782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.882232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.882682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] PATH_INFO: `/v3/projects/376496c7944849d09b34aec6c408e735/users/842c9ca8f59049bd8dcc4bb0e9b27032/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.901154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376496c7944849d09b34aec6c408e735, user_id=842c9ca8f59049bd8dcc4bb0e9b27032, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:50.904341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:50.923393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1053/2119] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:50 2022] PUT /identity/v3/projects/376496c7944849d09b34aec6c408e735/users/842c9ca8f59049bd8dcc4bb0e9b27032/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:50.928831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef2bc-1ce7-4bf5-84ca-12256c65229c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:50.929146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef2bc-1ce7-4bf5-84ca-12256c65229c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:50.929447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ef2bc-1ce7-4bf5-84ca-12256c65229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:50.949384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-989ef2bc-1ce7-4bf5-84ca-12256c65229c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:50.950610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-989ef2bc-1ce7-4bf5-84ca-12256c65229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:51.014910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1067/2120] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:51.027247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:51.029897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:51.098281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3909b-541f-4ca3-a259-480bb2940263 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:51.102198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:51.102832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:51.103471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:51.103755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:51.123464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:51.125198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:51.137239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1054/2121] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:23:56.493826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:56.498904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:56.501241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:56.524276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:56.548915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] MFA Rules not processed for user `842c9ca8f59049bd8dcc4bb0e9b27032`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:23:56.551311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:23:56.649870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1068/2122] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:23:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:23:56.652060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:56.663679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066afe06-8957-4c70-8756-5c5e22c4b86a service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:56.672112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:56.673042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:56.673321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:56.673640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:56.674829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:56.676642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:56.718378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1055/2123] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:23:56 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:23:56.722058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:56.736338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c340521-dca6-4f2f-9974-aa78c834fb78 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:56.824070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:56.824879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:56.825149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:56.825439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:56.826107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:56.828281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:56.863692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1069/2124] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:23:56 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:23:56.865075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:56.879840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81fd7d-34ba-4c9c-93ac-336f9e0bce92 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:56.886798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:56.887449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:56.887755 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:56.888021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:56.888694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:56.891144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:56.932452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1056/2125] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:23:56.936935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:56.947339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67f58a-8d93-4f31-a170-7012051c746e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:56.953755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:56.953755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:56.953755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:56.954022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] PATH_INFO: `/v3/projects/b11ce34ad846402aaa54574fc96bf334/users/1752ee71f4c045fea14c395c1dd7d291/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:56.974408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11ce34ad846402aaa54574fc96bf334, user_id=1752ee71f4c045fea14c395c1dd7d291, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:56.977201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:57.019504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1070/2126] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:56 2022] PUT /identity/v3/projects/b11ce34ad846402aaa54574fc96bf334/users/1752ee71f4c045fea14c395c1dd7d291/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:23:57.023830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:57.042818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a095e-0a0a-471e-ac29-a6d703e2b463 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:57.097579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:23:57.124963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:57.125605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:57.126207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:57.126579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:57.127494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:57.131342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:57.152152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1057/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:23:57.154036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:23:57.186858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8e9f-a128-4d74-b7e0-dd32303597fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:23:57.209969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:23:57.210847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:23:57.211131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:23:57.211404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] PATH_INFO: `/v3/projects/b11ce34ad846402aaa54574fc96bf334/users/1752ee71f4c045fea14c395c1dd7d291/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:23:57.214589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11ce34ad846402aaa54574fc96bf334, user_id=1752ee71f4c045fea14c395c1dd7d291, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:23:57.217365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:23:57.236079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1071/2128] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:23:57 2022] PUT /identity/v3/projects/b11ce34ad846402aaa54574fc96bf334/users/1752ee71f4c045fea14c395c1dd7d291/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:24:00.555326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:00.559547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:00.588041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350875-e4e4-458a-b2b8-47f53581a5c3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:00.678878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:00.679565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:00.679847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:00.680149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] PATH_INFO: `/v3/users/31c2d5a141b04cc0812166a59f3b9fa7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:00.681321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c2d5a141b04cc0812166a59f3b9fa7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:00.683907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:00.753421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c2d5a141b04cc0812166a59f3b9fa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:00.764891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c2d5a141b04cc0812166a59f3b9fa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:00.765521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c2d5a141b04cc0812166a59f3b9fa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:00.774518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c2d5a141b04cc0812166a59f3b9fa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:00.794771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c2d5a141b04cc0812166a59f3b9fa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:00.804490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1058/2129] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:24:00 2022] DELETE /identity/v3/users/31c2d5a141b04cc0812166a59f3b9fa7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:01.046829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:01.049192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:01.070049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fce9ff-7d11-4aa2-a67b-a5eb21bac554 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:01.147487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:01.163956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:01.168502 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:01.169606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:01.170348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] PATH_INFO: `/v3/projects/138d56d029b84d85bc4fead2dfa0f331` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:01.172341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=138d56d029b84d85bc4fead2dfa0f331)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:01.174828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:01.283234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138d56d029b84d85bc4fead2dfa0f331', 'request_id': 'req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.309221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138d56d029b84d85bc4fead2dfa0f331', 'request_id': 'req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.319498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138d56d029b84d85bc4fead2dfa0f331', 'request_id': 'req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.336994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] The token cache is being invalidate because project 138d56d029b84d85bc4fead2dfa0f331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:24:01.337455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.338884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.343480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1072/2130] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:24:01 2022] DELETE /identity/v3/projects/138d56d029b84d85bc4fead2dfa0f331 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:01.344754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:01.362585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605220e0-7edc-4414-9f5f-f0b51808051d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:01.550270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:01.567701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:01.571039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:01.572720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:01.573846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] PATH_INFO: `/v3/users/f1d9b411a15446f4b3846f07d3a2e8b0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:01.584415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d9b411a15446f4b3846f07d3a2e8b0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:01.586584 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:01.681040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d9b411a15446f4b3846f07d3a2e8b0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.700733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d9b411a15446f4b3846f07d3a2e8b0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.701361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d9b411a15446f4b3846f07d3a2e8b0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.718193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d9b411a15446f4b3846f07d3a2e8b0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.746636 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76fd3b20-675e-44df-ba5d-558111b41fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d9b411a15446f4b3846f07d3a2e8b0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:01.757397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1059/2131] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:24:01 2022] DELETE /identity/v3/users/f1d9b411a15446f4b3846f07d3a2e8b0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:02.286950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:02.299854 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:02.330586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bde32-9f7b-4cb1-b413-c00e0148d5bf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:02.446994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:02.448069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.448582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.449041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] PATH_INFO: `/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.450480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cd92e8d9b04dceaf6df38d112ce99e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:02.452955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:02.518065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cd92e8d9b04dceaf6df38d112ce99e', 'request_id': 'req-f43f82b5-218d-4b51-957c-5ed0cc970d63'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:02.546044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cd92e8d9b04dceaf6df38d112ce99e', 'request_id': 'req-f43f82b5-218d-4b51-957c-5ed0cc970d63'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:02.553905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cd92e8d9b04dceaf6df38d112ce99e', 'request_id': 'req-f43f82b5-218d-4b51-957c-5ed0cc970d63'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:02.581376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] The token cache is being invalidate because project 92cd92e8d9b04dceaf6df38d112ce99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:24:02.584009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:02.585813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f43f82b5-218d-4b51-957c-5ed0cc970d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:02.589380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1073/2132] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:24:02 2022] DELETE /identity/v3/projects/92cd92e8d9b04dceaf6df38d112ce99e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:02.599765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.600705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.600992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.628823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:02.630115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:02.712208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1060/2133] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:02.720905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.721194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.721478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.742793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:02.744061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:02.753806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1074/2134] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:02.758400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:02.769184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ca7ae-75a8-459d-916f-71edd8db6afc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:02.773975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:02.774593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.774865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.775131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.775907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:24:02.776235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:02.778103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:02.792239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1061/2135] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:24:02.796391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:02.801386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:02.809257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e8ba-2be4-41d3-90c9-e433233422f0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:02.815751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:02.816475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.816675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.816957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.817885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:02.820116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:02.862441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1075/2136] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:24:02 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:24:02.867712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:02.880682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a021f-e133-41ba-9deb-3611c68a8992 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:02.963808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:02.964628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:02.965048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:02.965460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:02.966259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:02.968566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:02.979369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:03.008562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1062/2137] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:24:02 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:24:03.012881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:03.027522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ea1ed-3715-49e3-9cea-6dd8bfe47347 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:03.033782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:03.034489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.034835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.035345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:03.039510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:03.041327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:03.054196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1076/2138] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:24:03.058727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:03.074414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c67f-a87e-4ab0-bdc4-09e226b44cbf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:03.079327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:03.079907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.082080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.082080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:03.082080 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:03.083829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a9985-1c9c-49f2-a28d-bcc5d0842fe9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:03.121235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1063/2139] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:24:03.125170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:03.137517 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ed2-b4d1-4452-86ea-82e273a40b2a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:03.161856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:03.162541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.162818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.163462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] PATH_INFO: `/v3/projects/0c6a242351f243d1a5ad8560cbf719b7/users/7772d68a88db48c99c1cd6123732ec7a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:03.196950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6a242351f243d1a5ad8560cbf719b7, user_id=7772d68a88db48c99c1cd6123732ec7a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:03.207265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:03.237711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1077/2140] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:24:03 2022] PUT /identity/v3/projects/0c6a242351f243d1a5ad8560cbf719b7/users/7772d68a88db48c99c1cd6123732ec7a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:03.254219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3fb1-f775-4834-a61b-44dcc59a8d27 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.254572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3fb1-f775-4834-a61b-44dcc59a8d27 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.255268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3fb1-f775-4834-a61b-44dcc59a8d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:03.331634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-41cf3fb1-f775-4834-a61b-44dcc59a8d27 None None] MFA Rules not processed for user `7772d68a88db48c99c1cd6123732ec7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:03.332960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-41cf3fb1-f775-4834-a61b-44dcc59a8d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:03.445076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1064/2141] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:03.456472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:03.459408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:03.563666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce117488-b718-40a8-aaed-e7aefe100f43 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:03.567746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:03.567989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.568261 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.568528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:03.578024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:03.579467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:03.588852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1078/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:24:03.985476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f615e-ed47-4d7f-b3c9-0e87764761b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:03.986633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f615e-ed47-4d7f-b3c9-0e87764761b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:03.987543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f615e-ed47-4d7f-b3c9-0e87764761b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:04.031162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3d9f615e-ed47-4d7f-b3c9-0e87764761b5 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:04.032585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3d9f615e-ed47-4d7f-b3c9-0e87764761b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:04.138333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1065/2143] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:04.152419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:04.154041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:04.311374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78cd4c-2a05-4c7e-9a18-979fce7dafbc service glance] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:04.317233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:04.317855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:04.318515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:04.318515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:04.328290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:04.329915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:04.339312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1079/2144] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:24:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:24:05.480825 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439b6fd-0ce7-4cc5-833c-b0d779b81041 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:05.481416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439b6fd-0ce7-4cc5-833c-b0d779b81041 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:05.481527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439b6fd-0ce7-4cc5-833c-b0d779b81041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:05.557631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6439b6fd-0ce7-4cc5-833c-b0d779b81041 None None] MFA Rules not processed for user `1752ee71f4c045fea14c395c1dd7d291`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:05.559031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6439b6fd-0ce7-4cc5-833c-b0d779b81041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:05.765757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:05.792740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1066/2145] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:05.809258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:05.810912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:05.859481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:05.971094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d662db-ae00-453f-8973-7a80c9074aa0 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:05.977420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:05.978141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:05.978803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:05.979191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:05.981253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:06.099784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:06.102696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c333f9-c848-49be-a90d-aa888d75fd44 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:06.114028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1080/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:07.747565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:07.748653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:07.748926 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:07.801559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] MFA Rules not processed for user `842c9ca8f59049bd8dcc4bb0e9b27032`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:07.809122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:07.844112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1067/2147] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:08.703185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c295-406a-47fd-b575-8b807c29f5a3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:08.703762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c295-406a-47fd-b575-8b807c29f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:08.704172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c295-406a-47fd-b575-8b807c29f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:08.734106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b898c295-406a-47fd-b575-8b807c29f5a3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:08.735766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b898c295-406a-47fd-b575-8b807c29f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:08.808752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1081/2148] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:08.831248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:08.833626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:08.851948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8cce-ec0a-4bd7-b9c7-59b0123b9caf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:08.861390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:08.862260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:08.862711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:08.863284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:08.877818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:08.879316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:08.890693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1068/2149] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:12.781250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf1ae-ea79-4c24-b72f-6f7fd9396bc2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:12.782221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf1ae-ea79-4c24-b72f-6f7fd9396bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:12.782499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cf1ae-ea79-4c24-b72f-6f7fd9396bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:12.804941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e43cf1ae-ea79-4c24-b72f-6f7fd9396bc2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:12.806262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e43cf1ae-ea79-4c24-b72f-6f7fd9396bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:12.815248 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1082/2150] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:12.840110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:12.852124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f41ed-28c1-44d8-9248-bac49292195b service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:12.859337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:12.859967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:12.860244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:12.860514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:12.869912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:12.871910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:12.884203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1069/2151] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:17.111474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a6dd-05c5-47a7-a906-d0094ca4211c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:17.112144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a6dd-05c5-47a7-a906-d0094ca4211c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:17.112144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43a6dd-05c5-47a7-a906-d0094ca4211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:17.138755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bb43a6dd-05c5-47a7-a906-d0094ca4211c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:17.140039 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bb43a6dd-05c5-47a7-a906-d0094ca4211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:17.148698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1083/2152] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:17.174775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:17.192202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99c31f-63d6-4490-8570-56792f6f2c5e service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:17.198771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:17.200362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:17.200841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:17.201438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:17.211682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:17.219514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:17.233208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1070/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:21.249766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6f2a-9faf-423a-b88f-332848dce404 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:21.250671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6f2a-9faf-423a-b88f-332848dce404 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:21.250928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b6f2a-9faf-423a-b88f-332848dce404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:21.272983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9d4b6f2a-9faf-423a-b88f-332848dce404 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:21.274265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9d4b6f2a-9faf-423a-b88f-332848dce404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:21.283775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1084/2154] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:21.322259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:21.336859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bdf5b-aef7-422d-9771-2447ddac4678 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:21.343250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:21.344007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:21.344282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:21.344548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:21.353754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:21.355403 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:21.366002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1071/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:24:27.560951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19ad8-4237-4438-9139-ca9ff0c32100 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:27.561774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19ad8-4237-4438-9139-ca9ff0c32100 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:27.561968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19ad8-4237-4438-9139-ca9ff0c32100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:27.598744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-64f19ad8-4237-4438-9139-ca9ff0c32100 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:27.600141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-64f19ad8-4237-4438-9139-ca9ff0c32100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:27.610165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1085/2156] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:27.634310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:27.646121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2a7ae-77c3-49a5-9420-5fb00a5edae4 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:27.652245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:27.652877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:27.653397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:27.653693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:27.662756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:27.664652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:27.675821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1072/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:31.220786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a3b2-27fb-4967-91f6-a14f5ac91011 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:31.221332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a3b2-27fb-4967-91f6-a14f5ac91011 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:31.221332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a3b2-27fb-4967-91f6-a14f5ac91011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:31.240103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-dfa3a3b2-27fb-4967-91f6-a14f5ac91011 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:31.241280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dfa3a3b2-27fb-4967-91f6-a14f5ac91011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:31.249255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1086/2158] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:24:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:31.266762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:31.278773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c46bc8-17fa-41d7-895b-2df77a9536f7 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:31.284184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:31.284786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:31.285061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:31.285330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:31.294520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:31.296150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:31.304177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1073/2159] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:24:32.802993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:32.803528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:32.804063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:32.827822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:32.829252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:32.839681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1087/2160] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:32.864907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:32.877616 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7649-8ebb-4610-a822-97e66f10fb9e service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:32.883778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:32.884418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:32.884775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:32.885006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:32.893759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:32.895373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:32.909513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1074/2161] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:33.305082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:33.306262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:33.319102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dfc36-9bb0-4f68-b713-a2de600f1d6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:33.324952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:33.325661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.325906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.326198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] PATH_INFO: `/v3/users/fd037159ae114915a68ad4f97cd5b92a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.327351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd037159ae114915a68ad4f97cd5b92a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:33.329313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:33.340467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:33.379833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd037159ae114915a68ad4f97cd5b92a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.380740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd037159ae114915a68ad4f97cd5b92a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.381453 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd037159ae114915a68ad4f97cd5b92a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.389224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd037159ae114915a68ad4f97cd5b92a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.401444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-58026bff-7884-46e1-8f64-b3921be4b7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd037159ae114915a68ad4f97cd5b92a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.418082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1088/2162] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:24:33 2022] DELETE /identity/v3/users/fd037159ae114915a68ad4f97cd5b92a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:33.600714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:33.611046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db9ed-cf46-42f5-b792-ed436fb3b845 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:33.672925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:33.673463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.673739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.674009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] PATH_INFO: `/v3/projects/61ea3df9e1d3424ba6a571782d04b9b2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.675185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ea3df9e1d3424ba6a571782d04b9b2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:33.677127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:33.728590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ea3df9e1d3424ba6a571782d04b9b2', 'request_id': 'req-d76b40e4-210d-441e-91ae-3159163740eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.736686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ea3df9e1d3424ba6a571782d04b9b2', 'request_id': 'req-d76b40e4-210d-441e-91ae-3159163740eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.747884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ea3df9e1d3424ba6a571782d04b9b2', 'request_id': 'req-d76b40e4-210d-441e-91ae-3159163740eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.750500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:33.762164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] The token cache is being invalidate because project 61ea3df9e1d3424ba6a571782d04b9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:24:33.762830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.763560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d76b40e4-210d-441e-91ae-3159163740eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:33.765209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1075/2163] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:24:33 2022] DELETE /identity/v3/projects/61ea3df9e1d3424ba6a571782d04b9b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:33.770235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.770540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.770782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.791621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:33.793371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:33.859491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1089/2164] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:33.867736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.868236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.868336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.890677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:33.891901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:33.900998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1076/2165] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:33.905305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:33.915753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4cc00-4ed4-4933-9e43-139bdf8c6a6d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:33.920434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:33.921014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.921289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.921560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.922212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:24:33.922515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:33.924199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:33.936630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1090/2166] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:24:33.941194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:33.950883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4301f-d536-4dbd-b9b8-551f3fea5bec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:33.956658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:33.957251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:33.957524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:33.957791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:33.958414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:33.960507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:33.992585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1077/2167] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:24:33 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:24:33.997496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:34.008328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5edeb-5b9d-4507-b969-a2791a4ee386 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:34.070965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:34.071573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.071855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.072162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.072795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:34.074734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:34.105215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1091/2168] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:24:33 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:24:34.107273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:34.122184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6166dc-3994-42eb-b0cc-0c7500492aff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:34.128170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:34.128808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.129084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.129337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.130008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:34.131633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:34.142682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1078/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:24:34.146521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:34.155191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:34.160068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8d883-a2b8-4137-afa1-bd0909bc583b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:34.168147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:34.168843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.169464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.169865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.171565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:34.173574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42356d2f-c3ac-44b1-b70d-990bc2e276f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:34.196975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1092/2170] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:24:34.197081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:34.202099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddaad2-ac4c-4436-a6b8-2aee8923d9b9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:34.206863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:34.207611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.207892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.208200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] PATH_INFO: `/v3/projects/3b7a0f6e49754adabc61bd0379129dbd/users/a2ce23079066429486dcf42c0f9f49a0/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.226872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7a0f6e49754adabc61bd0379129dbd, user_id=a2ce23079066429486dcf42c0f9f49a0, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:34.230392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:34.254300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1079/2171] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:24:34 2022] PUT /identity/v3/projects/3b7a0f6e49754adabc61bd0379129dbd/users/a2ce23079066429486dcf42c0f9f49a0/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:34.267320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af617470-2f0a-4534-92a1-6c20dce69b88 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.267752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af617470-2f0a-4534-92a1-6c20dce69b88 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.268064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af617470-2f0a-4534-92a1-6c20dce69b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.297944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-af617470-2f0a-4534-92a1-6c20dce69b88 None None] MFA Rules not processed for user `a2ce23079066429486dcf42c0f9f49a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:34.299389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-af617470-2f0a-4534-92a1-6c20dce69b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:34.376917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1093/2172] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:34.389071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:34.390883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:34.455665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12874-2804-4440-83a2-27db372cc49a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:34.460293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:34.461148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:34.461491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:34.461762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:34.470463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:34.472144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:34.482852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1080/2173] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:24:40.875530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc2c6-c3f6-4a0f-8aab-c19ffb684d63 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:40.876128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc2c6-c3f6-4a0f-8aab-c19ffb684d63 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:40.876128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc2c6-c3f6-4a0f-8aab-c19ffb684d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:40.896239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3c5cc2c6-c3f6-4a0f-8aab-c19ffb684d63 None None] MFA Rules not processed for user `fc564035b8ee4029a9caced9064f69cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:40.897428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3c5cc2c6-c3f6-4a0f-8aab-c19ffb684d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:40.932939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:40.934936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:40.964230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1094/2174] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:41.012055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbfc91-cb15-40ec-bae8-c03f234a4186 service glance] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:41.021408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:41.022300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:41.022673 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:41.023044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] PATH_INFO: `/v3/users/7772d68a88db48c99c1cd6123732ec7a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:41.024230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7772d68a88db48c99c1cd6123732ec7a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:41.027158 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:41.071941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:41.108389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7772d68a88db48c99c1cd6123732ec7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.121481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7772d68a88db48c99c1cd6123732ec7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.122146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7772d68a88db48c99c1cd6123732ec7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.132711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7772d68a88db48c99c1cd6123732ec7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.148663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7772d68a88db48c99c1cd6123732ec7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.161202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1081/2175] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:24:40 2022] DELETE /identity/v3/users/7772d68a88db48c99c1cd6123732ec7a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:41.165847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:41.166156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:41.166454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:41.186219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:41.187491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:41.255579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1095/2176] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:41.266340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:41.268018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:41.368295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ed02-167f-4a73-8ea7-b4ad644657ce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:41.373945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:41.374674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:41.375068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:41.375562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:41.389622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:41.393708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fa1bb-4791-400f-b3c9-7b01319267d2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:41.436357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1082/2177] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:41.743213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:41.749184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:41.775166 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54948e14-cf7e-43f1-bb5a-31b617fdd358 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:41.783734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:41.789583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:41.789836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:41.790262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] PATH_INFO: `/v3/projects/0c6a242351f243d1a5ad8560cbf719b7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:41.792280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6a242351f243d1a5ad8560cbf719b7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:41.796617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:41.832028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:41.867397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6a242351f243d1a5ad8560cbf719b7', 'request_id': 'req-70593a3d-6d26-49cb-afd7-a33d11a0b93c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.878123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6a242351f243d1a5ad8560cbf719b7', 'request_id': 'req-70593a3d-6d26-49cb-afd7-a33d11a0b93c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.886912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6a242351f243d1a5ad8560cbf719b7', 'request_id': 'req-70593a3d-6d26-49cb-afd7-a33d11a0b93c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.903291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] The token cache is being invalidate because project 0c6a242351f243d1a5ad8560cbf719b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:24:41.903673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.917370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-70593a3d-6d26-49cb-afd7-a33d11a0b93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:24:41.922521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1096/2178] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:24:41 2022] DELETE /identity/v3/projects/0c6a242351f243d1a5ad8560cbf719b7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:41.924479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:41.924835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:41.925251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:41.950247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:41.951874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:42.028886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1083/2179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:42.036623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.036963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.037432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.059317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:42.060571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:42.071740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1097/2180] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:42.073977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.088184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f93d4a-ae09-473c-b934-edc33fb8f5ff None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.093986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.094658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.095068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.095382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.096076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:24:42.096421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.098065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.112804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1084/2181] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:24:42.117227 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.128724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d42c7-8058-4001-9815-227c6abe3d3a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.133832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.134510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.134850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.135176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.135906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.138142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.176891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1098/2182] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:24:42 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:24:42.178019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.190283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0dce1-f997-47ad-a3a0-be4763b3b9d9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.242884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:42.272965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.273596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.273874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.274145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.274815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.276913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.309853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1085/2183] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:24:42 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:24:42.311433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.322553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c14bf5-56a9-4524-ac39-0a68318c7384 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.328286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.329036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.329375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.329928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.330648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.332397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.347443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1099/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:24:42.348762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.362021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d7075-dafc-433f-b064-ee48dbfbe709 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.368151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.368846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.369577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.370711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.371586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.373758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d09ff-1a06-41cd-a7e8-1c97145584f8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.389964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1086/2185] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:24:42.391264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.403939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427d7b-61ff-408a-8b1d-df9ce219cc69 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.410082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.410940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.411469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.411941 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] PATH_INFO: `/v3/projects/c7621c9dd45e4e7494edc180d54f2bb3/users/d56eb8dc3bdc46a5959f7f5e47b6a3a6/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.430095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7621c9dd45e4e7494edc180d54f2bb3, user_id=d56eb8dc3bdc46a5959f7f5e47b6a3a6, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.433127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.470052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1100/2186] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:24:42 2022] PUT /identity/v3/projects/c7621c9dd45e4e7494edc180d54f2bb3/users/d56eb8dc3bdc46a5959f7f5e47b6a3a6/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:24:42.486392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f750-ace4-4a4c-9284-dd81fa7d64ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.486696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f750-ace4-4a4c-9284-dd81fa7d64ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.486947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f750-ace4-4a4c-9284-dd81fa7d64ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.533001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2110f750-ace4-4a4c-9284-dd81fa7d64ff None None] MFA Rules not processed for user `d56eb8dc3bdc46a5959f7f5e47b6a3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:42.534277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2110f750-ace4-4a4c-9284-dd81fa7d64ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:42.644289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1087/2187] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:42.665778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:24:42.669160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:42.745870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae95a7-d89a-4e8f-8b57-cf0891bc3bba admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:24:42.751177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:24:42.752191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.752683 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.753083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:42.769187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:24:42.770982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c4319-a76c-49d5-b6e9-f0c1dbe6446d service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:24:42.781120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1101/2188] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:24:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:24:42.989009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:42.989551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:42.989676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:43.012505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] MFA Rules not processed for user `83cdff24514c42679e46d8f5b7c27fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:43.013742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:43.082356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1088/2189] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:24:52.777177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:53.074994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:24:55.811884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:24:55.812495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:24:55.812597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:24:55.834224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] MFA Rules not processed for user `1f33a883115442b4a65677cbd1026525`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:24:55.835797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:24:55.931787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1102/2190] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:00.678497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:00.679424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:00.679939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:00.683514 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:00.790136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb813-8761-44a8-b105-50695ebf28a5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:00.796929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:00.797743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:00.798086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:00.798421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:00.799655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1e0b-5bc7-4829-9c1e-6d816b898725 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:00.800408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:00.805034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:00.805658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:00.805936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:00.806199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:00.814140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:00.815562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:00.815757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:00.817343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097124-89d3-4fa3-80c5-f569857833fe service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:00.827251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1089/2191] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:00.829411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1103/2192] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:10.822612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=32 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:10.824257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=57 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:16.874577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:16.876232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:16.944749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac843e-e86c-4b0e-acfc-caf0428206c6 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:16.949911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:16.950538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:16.950973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:16.951381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] PATH_INFO: `/v3/users/a2ce23079066429486dcf42c0f9f49a0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:16.952563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ce23079066429486dcf42c0f9f49a0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:16.954487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:17.006162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ce23079066429486dcf42c0f9f49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.014063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ce23079066429486dcf42c0f9f49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.014695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ce23079066429486dcf42c0f9f49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.021693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ce23079066429486dcf42c0f9f49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.034493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ce23079066429486dcf42c0f9f49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.040527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1090/2193] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:25:16 2022] DELETE /identity/v3/users/a2ce23079066429486dcf42c0f9f49a0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:17.045391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:17.045931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:17.045931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:17.066001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:17.067199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:17.136798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1104/2194] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:25:17.147705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:17.149604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:17.275532 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a809f-210c-4669-955c-52666d56c6bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:17.294059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:17.296575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:17.296846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:17.297715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:17.313201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:17.315256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac966b-7a02-45d3-9ad2-9dad31b99a0f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:17.333332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1091/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:17.802241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:17.813534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:17.825434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3618-b258-47b2-a2aa-e51d9b568a31 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:17.830423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:17.831059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:17.831336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:17.831610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] PATH_INFO: `/v3/projects/3b7a0f6e49754adabc61bd0379129dbd` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:17.832865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7a0f6e49754adabc61bd0379129dbd)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:17.834812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:17.887218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7a0f6e49754adabc61bd0379129dbd', 'request_id': 'req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.895285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7a0f6e49754adabc61bd0379129dbd', 'request_id': 'req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.905760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7a0f6e49754adabc61bd0379129dbd', 'request_id': 'req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.920498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] The token cache is being invalidate because project 3b7a0f6e49754adabc61bd0379129dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:25:17.920894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.922037 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3c8ebb32-5d3a-4d17-98a8-cf48cff4d5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:17.927317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1105/2196] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:25:17 2022] DELETE /identity/v3/projects/3b7a0f6e49754adabc61bd0379129dbd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:17.929802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:17.930311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:17.930426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:17.952014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:17.953227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:17.970083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:18.013810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1092/2197] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:25:18.021895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.022150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.022452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.044049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:18.045254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:18.054215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1106/2198] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:18.058874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.069012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e26bf8-ef4b-4919-96db-334b2066ef0c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.074009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.074628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.074937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.075207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.076082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:25:18.076400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.078011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.091499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1093/2199] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:25:18.096539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.106508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a14a9-aa61-4794-bceb-f760f30b20b4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.112739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.113494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.113892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.114211 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.115796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.118314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.155589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1107/2200] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:25:18 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:25:18.156718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.167602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a832e-81cc-48e6-8be6-90fe42989efc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.227253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.227859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.228162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.228432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.229053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.230989 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.253976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1094/2201] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:25:18 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:25:18.258093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.270400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeedd99-8576-4a00-97df-3c0092dde68f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.276516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.277233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.277512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.277782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.278433 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.280664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.291427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1108/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:25:18.295586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.306225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91091a35-4704-452f-8144-3ece3427c33e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.311618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.312255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.312556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.312808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.313455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.315053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2128df1-ec86-4667-bd4f-db9207d35165 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.325573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1095/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:25:18.330318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.346213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e8319-ff7d-45b1-8bdf-3b333918aa08 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.353691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.354622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.354950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.355202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] PATH_INFO: `/v3/projects/d16d983baa2c4e0f9ec3cd12f0ca9d4a/users/c6b956e5ea5c4bcda3528736eb874101/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.372489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16d983baa2c4e0f9ec3cd12f0ca9d4a, user_id=c6b956e5ea5c4bcda3528736eb874101, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.375852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.394438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1109/2204] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:25:18 2022] PUT /identity/v3/projects/d16d983baa2c4e0f9ec3cd12f0ca9d4a/users/c6b956e5ea5c4bcda3528736eb874101/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:18.406664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.406943 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.407220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.439561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] MFA Rules not processed for user `c6b956e5ea5c4bcda3528736eb874101`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:18.440838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:18.534187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1096/2205] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:18.545599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:18.547404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:18.569584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:18.609914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ef909-cff3-451f-9fac-1627f1e91f12 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:18.614154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:18.614882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:18.615254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:18.615637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:18.625068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:18.626592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bad57-74b8-4f59-a060-e542a9c8a01b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:18.635698 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1110/2206] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:22.213583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:22.215312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:22.237267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:22.284073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2afdc4-8149-4d2c-9c6a-3f077892f645 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:22.288823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:22.289456 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:22.289735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:22.290008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] PATH_INFO: `/v3/users/d56eb8dc3bdc46a5959f7f5e47b6a3a6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:22.291147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56eb8dc3bdc46a5959f7f5e47b6a3a6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:22.293157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:22.340010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56eb8dc3bdc46a5959f7f5e47b6a3a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.347888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56eb8dc3bdc46a5959f7f5e47b6a3a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.348531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56eb8dc3bdc46a5959f7f5e47b6a3a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.356726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56eb8dc3bdc46a5959f7f5e47b6a3a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.369941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56eb8dc3bdc46a5959f7f5e47b6a3a6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.377088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1097/2207] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:25:22 2022] DELETE /identity/v3/users/d56eb8dc3bdc46a5959f7f5e47b6a3a6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:22.382046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:22.382554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:22.382652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:22.402565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:22.403929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:22.463354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1111/2208] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:22.473233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:22.474773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:22.534010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79209e54-c975-421a-80b4-3b6bb7177a59 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:22.538581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:22.539192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:22.539478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:22.539874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:22.549892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:22.551328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8025e-e5c0-4dcf-8e67-3c8964a2cb74 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:22.561303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1098/2209] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:22.865435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:22.867561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:22.880633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9294a01-a741-499f-81ed-69c207439f00 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:22.886880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:22.887641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:22.888360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:22.888479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] PATH_INFO: `/v3/projects/c7621c9dd45e4e7494edc180d54f2bb3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:22.889939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7621c9dd45e4e7494edc180d54f2bb3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:22.891909 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:22.946059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7621c9dd45e4e7494edc180d54f2bb3', 'request_id': 'req-782b9447-a7a7-48cc-a618-976511f4528f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.954525 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7621c9dd45e4e7494edc180d54f2bb3', 'request_id': 'req-782b9447-a7a7-48cc-a618-976511f4528f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.960744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7621c9dd45e4e7494edc180d54f2bb3', 'request_id': 'req-782b9447-a7a7-48cc-a618-976511f4528f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.970959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] The token cache is being invalidate because project c7621c9dd45e4e7494edc180d54f2bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:25:22.971243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.971866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-782b9447-a7a7-48cc-a618-976511f4528f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:22.973362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1112/2210] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:25:22 2022] DELETE /identity/v3/projects/c7621c9dd45e4e7494edc180d54f2bb3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:22.978083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:22.978366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:22.978638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.005247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:23.006519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.045524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:23.085724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1099/2211] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:23.094725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.095006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.095279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.123386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:23.124935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.144335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.146097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1113/2212] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:23.153036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974e29c-cd2c-4d02-b1d3-02360598c032 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.158528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.159157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.159439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.159713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.160468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:25:23.160839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.162534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.179660 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1100/2213] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:25:23.184697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.195156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a78d1a-b682-4be2-9d3f-6a76ffd6abf1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.206144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.206905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.207271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.207612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.208356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.212165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.260294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1114/2214] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:25:23 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:25:23.261600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.275157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4df20-1fda-421c-bd04-e29aebefc8a8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.366404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.367528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.367883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.368375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.369162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.371243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.400047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1101/2215] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:25:23 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:25:23.404410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.418773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b15427-f275-4cd9-8f18-b5a108c5634f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.424464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.425095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.425458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.425727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.427075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.428780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.444134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1115/2216] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:25:23.445436 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.457360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf86a-4320-4516-b05b-9ff843a90567 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.463384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.464266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.464604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.464951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.465893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.467706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c09e-b31b-4053-9c4a-f08c9e1ab8a4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.490151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1102/2217] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:25:23.495053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.516899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c13705-7ad9-42c3-b7d0-41dbc3a86fe5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.522085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.522752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.523025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.523298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] PATH_INFO: `/v3/projects/f1517ae64a7246218c95f179678fc8d8/users/4ec7e5074ac94a0590f4726c6e567056/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.526020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:23.543298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1517ae64a7246218c95f179678fc8d8, user_id=4ec7e5074ac94a0590f4726c6e567056, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.546699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.564716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1116/2218] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:25:23 2022] PUT /identity/v3/projects/f1517ae64a7246218c95f179678fc8d8/users/4ec7e5074ac94a0590f4726c6e567056/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:23.575108 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.575507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.576170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.607488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] MFA Rules not processed for user `4ec7e5074ac94a0590f4726c6e567056`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:23.608720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.669842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.672471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.688667 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1103/2219] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:25:23.695614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:23.701859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.741142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a57c7d-8b0a-4f7f-ac8a-9b126e1d37f5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.745256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.745870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.746149 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.746447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.748259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:23.753966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:23.773639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f4747-6e1a-45e4-ac43-e2396958ebc4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:23.777614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:23.778272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:23.779199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:23.779478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:23.788408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.789862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.799628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1104/2220] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:23 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:23.831262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:23.833531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:23.846863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1117/2221] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:29.202803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:29.224829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:29.226492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:29.273992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a85785-0b4b-48e7-ae60-99c8c443ce31 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:29.279074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:29.279741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.280045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.280311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] PATH_INFO: `/v3/users/4ec7e5074ac94a0590f4726c6e567056` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.281440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec7e5074ac94a0590f4726c6e567056)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:29.283370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:29.294823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80ac7-bc6b-4000-83d6-e75d678d5c2e service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:29.300308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:29.301176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.301452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.301727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] PATH_INFO: `/v3/users/c6b956e5ea5c4bcda3528736eb874101` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.302928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b956e5ea5c4bcda3528736eb874101)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:29.304955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:29.340548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec7e5074ac94a0590f4726c6e567056'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.350143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec7e5074ac94a0590f4726c6e567056'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.350995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec7e5074ac94a0590f4726c6e567056'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.352034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:29.361635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec7e5074ac94a0590f4726c6e567056'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.367161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b956e5ea5c4bcda3528736eb874101'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.367847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b956e5ea5c4bcda3528736eb874101'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.368579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b956e5ea5c4bcda3528736eb874101'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.382249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4cc18e59-da93-42ed-8b62-62264487ca35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec7e5074ac94a0590f4726c6e567056'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.383980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b956e5ea5c4bcda3528736eb874101'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.392013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1105/2222] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:25:29 2022] DELETE /identity/v3/users/4ec7e5074ac94a0590f4726c6e567056 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:29.396575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.397557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.397557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.400055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1ba807c9-0da4-4cba-ba8b-83efc9c12947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b956e5ea5c4bcda3528736eb874101'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:29.422201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1118/2223] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:25:29 2022] DELETE /identity/v3/users/c6b956e5ea5c4bcda3528736eb874101 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:29.423269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:29.424748 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:29.427357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.427785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.428134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.457198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:29.458664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:29.503572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:29.520105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1106/2224] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:25:29.529294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:29.531033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:29.548374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1119/2225] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:29.557924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:29.559629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:29.613703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d92a19-8724-4a2e-b0f6-0ba6b51d460b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:29.618696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:29.619318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.619588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.619879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.630286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:29.631780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:29.643728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1107/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:29.674807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b094ffc-ef68-4ad7-a796-1d32e469ff3d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:29.678794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:29.679334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:29.679609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:29.679880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:29.689107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:29.690533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:29.700134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1120/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:25:30.033546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.035048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.050430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f260-10f9-4822-a65b-1f156fcb23fd service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.055251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.055907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.056228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.056528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] PATH_INFO: `/v3/projects/f1517ae64a7246218c95f179678fc8d8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.057641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1517ae64a7246218c95f179678fc8d8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.059618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.109119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1517ae64a7246218c95f179678fc8d8', 'request_id': 'req-6c78915d-5009-4b5c-9512-db94178ab135'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.115442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1517ae64a7246218c95f179678fc8d8', 'request_id': 'req-6c78915d-5009-4b5c-9512-db94178ab135'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.124903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1517ae64a7246218c95f179678fc8d8', 'request_id': 'req-6c78915d-5009-4b5c-9512-db94178ab135'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.136602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] The token cache is being invalidate because project f1517ae64a7246218c95f179678fc8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:25:30.137904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.138624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6c78915d-5009-4b5c-9512-db94178ab135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.140286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1108/2228] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:25:30 2022] DELETE /identity/v3/projects/f1517ae64a7246218c95f179678fc8d8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:25:30.170178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.172013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.186204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16ed85-d6ad-4d59-9734-f87a4424efa1 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.249483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:30.259534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.260871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.261606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.261890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] PATH_INFO: `/v3/projects/d16d983baa2c4e0f9ec3cd12f0ca9d4a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.264232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16d983baa2c4e0f9ec3cd12f0ca9d4a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.266328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.319785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16d983baa2c4e0f9ec3cd12f0ca9d4a', 'request_id': 'req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.328954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16d983baa2c4e0f9ec3cd12f0ca9d4a', 'request_id': 'req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.336409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16d983baa2c4e0f9ec3cd12f0ca9d4a', 'request_id': 'req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.348235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] The token cache is being invalidate because project d16d983baa2c4e0f9ec3cd12f0ca9d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:25:30.348511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.349186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-149884d7-cbb0-40d3-bd3a-d33d0cf0e863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:30.350972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1121/2229] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:25:30 2022] DELETE /identity/v3/projects/d16d983baa2c4e0f9ec3cd12f0ca9d4a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:30.356103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.356590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.356690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.378018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:30.379230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.440049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1109/2230] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:30.448182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.448495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.448756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.469345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:30.470541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.479052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1122/2231] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:30.484101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.494531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf10d5-94ad-460e-b835-36821ffadbeb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.499904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.500555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.500831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.501100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.501742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:25:30.502041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.503651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.515483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1110/2232] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:25:30.521566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.531600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615181-2b64-48d4-8298-b9955b65a253 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.536630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.537215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.537486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.537745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.538371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.540321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.571970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1123/2233] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:25:30 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:25:30.575853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.586702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e55c1-c9ef-47fc-a1d0-9267ca7c0736 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.596084 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:30.647770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.648540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.648898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.649307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.649936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.651847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.679534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1111/2234] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:25:30 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:25:30.681106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.692372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49506a7-2a28-48bb-9f47-a27e2d2514e2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.700383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.701001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.701312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.701603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.702221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.703829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.717593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1124/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:25:30.718776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.733469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aae60-dd32-4037-ad47-cd19272f35b8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.739134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.739760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.740073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.740344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.740995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.742957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c8cbf-70f8-478a-88a1-1a8d36764f05 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.755141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1112/2236] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:25:30.759406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.770072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c467-3dad-4151-8047-abdfb9c01490 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.775181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.775820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.776118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.776385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] PATH_INFO: `/v3/projects/46ca166dcf7b4c699727b06abfa2d32e/users/27717d081c974e2c97749372a03cfbc6/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.792380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ca166dcf7b4c699727b06abfa2d32e, user_id=27717d081c974e2c97749372a03cfbc6, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:30.795024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:30.809518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1125/2237] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:25:30 2022] PUT /identity/v3/projects/46ca166dcf7b4c699727b06abfa2d32e/users/27717d081c974e2c97749372a03cfbc6/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:30.820020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5532-d72f-4e5d-995a-aaf92cde2638 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.820307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5532-d72f-4e5d-995a-aaf92cde2638 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.820608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5532-d72f-4e5d-995a-aaf92cde2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:30.849363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bfcb5532-d72f-4e5d-995a-aaf92cde2638 None None] MFA Rules not processed for user `27717d081c974e2c97749372a03cfbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:30.850572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bfcb5532-d72f-4e5d-995a-aaf92cde2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.920844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1113/2238] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:30.932304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:30.934138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:30.991120 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c47573-3454-4209-90b4-b73c8dd50f33 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:30.995655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:30.996288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:30.996568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:30.996834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:31.005827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:31.007243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:31.016332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1126/2239] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:35.992871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603260d-693a-4a0e-a9da-003ca4de53b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:35.993478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603260d-693a-4a0e-a9da-003ca4de53b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:35.993478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603260d-693a-4a0e-a9da-003ca4de53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:36.016114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9603260d-693a-4a0e-a9da-003ca4de53b3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:36.017778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9603260d-693a-4a0e-a9da-003ca4de53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:36.086234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1114/2240] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:36.122308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:36.123876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:36.153704 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:36.205867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936de63-6083-4ca6-b5ad-2ec5aa1ec0df service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:36.214223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:36.214839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:36.215129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:36.215379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:36.225520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:36.227109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:36.237014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1127/2241] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:40.411527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:40.412102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:40.412102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:40.432622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:40.433798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:40.442500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1115/2242] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:40.477312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:40.479063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:40.494661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6f91-5da5-4eda-b560-8aaad1156e79 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:40.501036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:40.501839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:40.502154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:40.502490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:40.511503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:40.513201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea219-8b7c-4be5-8347-7834b36f157a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:40.524063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1128/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:41.208112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:41.218444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb94a8c-a95f-43c3-bae4-b7ce18cf8830 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:41.223843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:41.224585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:41.224909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:41.225248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] PATH_INFO: `/v3/users/27717d081c974e2c97749372a03cfbc6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:41.226521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27717d081c974e2c97749372a03cfbc6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:41.228464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:41.234035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:41.283677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27717d081c974e2c97749372a03cfbc6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.292977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27717d081c974e2c97749372a03cfbc6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.293672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27717d081c974e2c97749372a03cfbc6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.301780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27717d081c974e2c97749372a03cfbc6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.314071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27717d081c974e2c97749372a03cfbc6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.320550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1116/2244] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:25:41 2022] DELETE /identity/v3/users/27717d081c974e2c97749372a03cfbc6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:41.325221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:41.325509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:41.325786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:41.345189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:41.346468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:41.418562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1129/2245] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:41.428819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:41.430417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:41.489389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8a2c2-f401-43ea-8f11-5728909755e1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:41.493977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:41.494583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:41.494860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:41.495141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:41.505424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:41.507623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51589fd0-9532-4b15-88a0-71f80717d297 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:41.521070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1117/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:41.809519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:41.811756 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:41.828498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b9c12-213a-4f0a-a19e-b48535f35ca5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:41.838132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:41.839158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:41.839620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:41.840198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] PATH_INFO: `/v3/projects/46ca166dcf7b4c699727b06abfa2d32e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:41.842100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ca166dcf7b4c699727b06abfa2d32e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:41.846040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:41.899086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ca166dcf7b4c699727b06abfa2d32e', 'request_id': 'req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.909194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ca166dcf7b4c699727b06abfa2d32e', 'request_id': 'req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.915710 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ca166dcf7b4c699727b06abfa2d32e', 'request_id': 'req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.926753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] The token cache is being invalidate because project 46ca166dcf7b4c699727b06abfa2d32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:25:41.926979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.927662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:25:41.929252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1130/2247] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:25:41 2022] DELETE /identity/v3/projects/46ca166dcf7b4c699727b06abfa2d32e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:25:44.433199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8561-c071-4232-a444-1f051ea3ece4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:44.433785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8561-c071-4232-a444-1f051ea3ece4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:44.433785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada8561-c071-4232-a444-1f051ea3ece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:44.457341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2ada8561-c071-4232-a444-1f051ea3ece4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:44.458618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ada8561-c071-4232-a444-1f051ea3ece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:44.522694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1118/2248] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:44.566701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:44.568398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:44.592452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:25:44.645980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0864fd-81b9-4ca6-89ea-a1c0d287eeb8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:44.652078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:44.652684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:44.652960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:44.653232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:44.661936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:44.663497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:44.672982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1131/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:48.664940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd13c-1be2-4581-a59f-fa4ea4b48088 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:48.665866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd13c-1be2-4581-a59f-fa4ea4b48088 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:48.666038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd13c-1be2-4581-a59f-fa4ea4b48088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:48.700235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-653bd13c-1be2-4581-a59f-fa4ea4b48088 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:48.701951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-653bd13c-1be2-4581-a59f-fa4ea4b48088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:48.714639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1119/2250] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:48.739511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:48.741417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:48.757244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c1a51-3e21-4dcd-882f-7067cc115dfd service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:48.763455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:48.764095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:48.764377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:48.764652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:48.774461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:48.776114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:48.786301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1132/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:25:52.878585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4ec31-45c0-44e8-a342-8750e6e2f733 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:52.879310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4ec31-45c0-44e8-a342-8750e6e2f733 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:52.879310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4ec31-45c0-44e8-a342-8750e6e2f733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:52.907634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d0f4ec31-45c0-44e8-a342-8750e6e2f733 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:25:52.908859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0f4ec31-45c0-44e8-a342-8750e6e2f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:25:52.919960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1120/2252] 10.222.0.17 () {58 vars in 1016 bytes} [Wed Aug 17 11:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:25:52.957511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:25:52.970851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af637b-57c9-4fee-b72e-2d6bb0c2ca1a service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:25:52.978935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:25:52.979534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:25:52.979820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:25:52.980092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:25:52.990114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:25:52.992420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:25:53.006200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1133/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:26:02.902050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:02.999630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=37 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:23.425654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:23.425654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:23.426125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:23.446714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:26:23.448072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:23.507626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1121/2254] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:26:23.558162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:23.559635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:23.634983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eadd5-bea5-4cf8-8d77-f6665ef48959 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:23.640008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:23.640619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:23.640896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:23.641167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:23.648940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:23.650524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:23.658500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1134/2255] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:26:26.842898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:26.845682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:26.867561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f14d57-4da0-4f4a-a478-a62b2517df43 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:26.872711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:26.873595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:26.874283 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:26.875236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] PATH_INFO: `/v3/users/1f33a883115442b4a65677cbd1026525` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:26.877609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f33a883115442b4a65677cbd1026525)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:26.879820 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:26.937591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f33a883115442b4a65677cbd1026525'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:26.948784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f33a883115442b4a65677cbd1026525'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:26.949697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f33a883115442b4a65677cbd1026525'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:26.957720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f33a883115442b4a65677cbd1026525'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:26.972148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ed12e8c-40c4-40a4-9b1c-5f8b18ea0c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f33a883115442b4a65677cbd1026525'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:26.980783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1122/2256] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:26:26 2022] DELETE /identity/v3/users/1f33a883115442b4a65677cbd1026525 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:26:27.287459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:27.300804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4cfab-e4a8-4d94-a3b5-80745782e03e service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:27.364713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:27.365537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:27.365841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:27.366280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] PATH_INFO: `/v3/projects/d07bc10178c14c159ae661fa4e887a0b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:27.367464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07bc10178c14c159ae661fa4e887a0b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:27.369427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:27.426903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07bc10178c14c159ae661fa4e887a0b', 'request_id': 'req-7ed56d33-3674-4b66-a138-aa94f2b6dfae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:27.436252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07bc10178c14c159ae661fa4e887a0b', 'request_id': 'req-7ed56d33-3674-4b66-a138-aa94f2b6dfae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:27.443047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07bc10178c14c159ae661fa4e887a0b', 'request_id': 'req-7ed56d33-3674-4b66-a138-aa94f2b6dfae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:27.454339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] The token cache is being invalidate because project d07bc10178c14c159ae661fa4e887a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:26:27.454629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:27.455314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7ed56d33-3674-4b66-a138-aa94f2b6dfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:26:27.456928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1135/2257] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:26:27 2022] DELETE /identity/v3/projects/d07bc10178c14c159ae661fa4e887a0b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:26:36.975807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:37.451635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:38.679679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:38.680351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:38.680351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:38.681889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1123/2258] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:26:38.688420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc2e6-9683-4e88-b840-b92346401eb7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:38.688965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc2e6-9683-4e88-b840-b92346401eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:38.689095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc2e6-9683-4e88-b840-b92346401eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:38.710526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bf3cc2e6-9683-4e88-b840-b92346401eb7 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:26:38.711652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf3cc2e6-9683-4e88-b840-b92346401eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:38.786855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1136/2259] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:26:38.799826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:38.801908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:38.863400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cb721-b699-45fa-bb58-8ce6137bc7d6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:38.867056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:38.867672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:38.867953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:38.868249 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:38.878514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:38.880211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aa6e5-6785-485e-a5b6-615023e74fa5 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:38.893527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1124/2260] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:26:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:26:38.966423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:38.966637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:38.966937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:38.968349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1137/2261] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:26:38.973168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08307ff-aea3-4422-8f39-e0bf2e704e7b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:38.973460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08307ff-aea3-4422-8f39-e0bf2e704e7b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:38.973761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08307ff-aea3-4422-8f39-e0bf2e704e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:38.995714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b08307ff-aea3-4422-8f39-e0bf2e704e7b None None] MFA Rules not processed for user `41154775379d4f0da94e06f8f3fd1455`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:26:38.996986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b08307ff-aea3-4422-8f39-e0bf2e704e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:39.053154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1125/2262] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:26:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:26:39.065408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:39.067133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:39.081032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0496bb3-537a-4a21-99b6-a42bb08d77bb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:39.084652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:39.085382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:39.085510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:39.085780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:39.093320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:39.094821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287339e3-040d-4c9c-a906-fe02a16f4585 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:39.103095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1138/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:26:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:26:39.190280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49056-1bfb-4f42-96b6-e21f134aba6a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:39.190582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49056-1bfb-4f42-96b6-e21f134aba6a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:39.190829 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49056-1bfb-4f42-96b6-e21f134aba6a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:39.192547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1126/2264] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 17 11:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 11:26:39.198172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdcb5-2adb-40b7-a49e-cabdf03c1c33 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:39.198461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdcb5-2adb-40b7-a49e-cabdf03c1c33 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:39.198765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cdcb5-2adb-40b7-a49e-cabdf03c1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:39.218724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-917cdcb5-2adb-40b7-a49e-cabdf03c1c33 None None] MFA Rules not processed for user `991c9767714849039e301854775dac09`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:26:39.219860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-917cdcb5-2adb-40b7-a49e-cabdf03c1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:39.229263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1139/2265] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 17 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:26:39.240978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a49056-1bfb-4f42-96b6-e21f134aba6a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:39.252508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a49056-1bfb-4f42-96b6-e21f134aba6a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:39.256227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:39.256832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:39.257112 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:39.257383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:39.267678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:39.269188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:39.280679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1127/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:26:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:26:41.971876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:41.972451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:41.972451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:41.994577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:26:41.995782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:42.056701 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1140/2267] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:26:42.071894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:42.074071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:42.150404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d3d2-6cfb-47dd-9611-aa2b6804581e service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:42.157243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:42.157883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:42.158794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:42.159075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:42.169238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:42.171012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:42.179278 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1128/2268] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:26:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:26:52.049228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=65 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:52.175998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:26:56.678916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:56.688939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069dc6c-b08f-4660-8a65-db9d896c8fdf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:56.693796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:56.694406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:56.694679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:56.694983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:56.697219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:56.711620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:56.713095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7504fc-8f37-483d-93ef-d20e50806d17 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:56.724968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1141/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:26:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:26:57.175561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:26:57.177649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:57.240974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb927-ede7-4500-8516-a3af9ef54978 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:26:57.245603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:26:57.246154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:26:57.246433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:26:57.246731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:26:57.248948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:26:57.263473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:26:57.265608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:26:57.279979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1129/2270] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:26:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:06.719483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:07.273325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=26 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:09.138004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:09.138844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:09.139271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:09.176028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:27:09.177306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:09.184531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1142/2271] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:27:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:27:09.197341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:09.212695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ac79-373c-4936-a7bd-96a456103c38 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:09.217823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:09.218450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:09.218731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:09.219029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:09.229114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:09.231056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:09.246042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1130/2272] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:27:12.227338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:12.228998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:12.242105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e8dc0-542c-45ef-aeba-9f7d047206aa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:12.246323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:12.246956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:12.247235 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:12.247522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:12.249373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:12.311522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:12.313046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:12.322492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1143/2273] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:15.046679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:15.048670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:15.065513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9698d45-2c8c-4195-9960-6d318cebc4da service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:15.072311 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:15.072930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:15.073211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:15.073483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:15.075478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:15.135904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:15.137536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d28c6-68b0-454e-b471-b9aedf94ba1d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:15.146941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1131/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:20.372567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:20.374091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:20.386954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe70be-860a-4a75-aaf9-eb5793327dcf service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:20.391187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:20.391811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:20.392207 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:20.392486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:20.394455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:20.406340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:20.408043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:20.417081 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1144/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:20.508125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:20.508806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:20.508806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:20.527525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] MFA Rules not processed for user `83cdff24514c42679e46d8f5b7c27fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:27:20.528743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:20.535966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1132/2276] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:27:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:27:20.867033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:20.876669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788aa08-818e-416d-9e1b-59602c2898cc service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:20.881384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:20.882026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:20.882309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:20.882576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:20.884581 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:20.894524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:20.895962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a0b1-9c3d-4ea8-9e4e-3cceea5536f0 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:20.904553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1145/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:21.473814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:21.475231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:21.545199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cd166-9b34-4ccd-a989-5387408fb065 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:21.550554 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:21.551219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:21.551469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:21.551762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:21.553618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:21.565228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:21.566853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:21.576505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1133/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:22.621775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:22.622320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:22.622320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:22.643564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] MFA Rules not processed for user `fc564035b8ee4029a9caced9064f69cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:27:22.645305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:22.652505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1146/2279] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:27:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:27:28.806470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:28.809165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:28.825595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91119e51-7f66-4b54-903c-8fbd33784496 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:28.832662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:28.833442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:28.833855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:28.834280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:28.836284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:28.849073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:28.850767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:28.862027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1134/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:32.638560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=46 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:38.040833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:27:38.054107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae10cb5-5404-4b72-829a-c0528bc0b482 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:27:38.060278 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:27:38.060918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:27:38.061187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:27:38.061458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:27:38.063296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:27:38.076458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:27:38.078091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728240b-6855-4064-b7b5-f497d7878aed service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:27:38.089107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1147/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:27:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:27:38.857180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=75 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:27:48.084817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:07.201175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:28:07.212737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42d1f-aadb-433f-a0e3-61058a1fc0d1 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:28:07.217642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:28:07.218299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:28:07.218602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:28:07.218904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:28:07.221199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:28:07.283962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:28:07.285421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:28:07.295372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1135/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:28:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:28:13.382738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c6be-a6d9-4477-a659-1fad8165999f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:28:13.383279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c6be-a6d9-4477-a659-1fad8165999f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:28:13.383279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c6be-a6d9-4477-a659-1fad8165999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:28:13.405421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1f20c6be-a6d9-4477-a659-1fad8165999f None None] MFA Rules not processed for user `9c06d5a51e984f36879bbb86b6d60513`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:28:13.406632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f20c6be-a6d9-4477-a659-1fad8165999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:28:13.414798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1148/2283] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:28:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:28:17.290908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=28 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:22.249698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:28:22.269367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb69f9-16b7-4b9d-9664-4aeed99d1350 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:28:22.278262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:28:22.279200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:28:22.279477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:28:22.279976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:28:22.281871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:28:22.298125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:28:22.300174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:28:22.314877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1136/2284] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:28:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:28:23.400144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:30.274861 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:28:30.275535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:28:30.275633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:28:30.295846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] MFA Rules not processed for user `5305d254a2eb47ec932088b7d75129a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:28:30.297162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:28:30.356116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1149/2285] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:28:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:28:30.368402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:28:30.379340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4351cb-642d-4e9a-a644-41473af42dcf service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:28:30.385906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:28:30.386545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:28:30.386824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:28:30.387099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:28:30.389075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:28:30.400037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:28:30.401703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:28:30.411467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1137/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:28:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:28:40.348310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=25 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:28:40.406942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=12 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:02.427511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:02.443301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ea0be-dfd7-4e94-8d13-86e493866761 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:02.450504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:02.451110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:02.451377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:02.451640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:02.453992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:02.524610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:02.526051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:02.536702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1150/2287] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:06.033042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.049712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2b500-69e6-42a8-b50f-c71d80763cac service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:06.055690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:06.056737 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.057226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.057704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.059860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:06.081497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:06.086603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:06.104130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1138/2288] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:06.110414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.111975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:06.125708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eb74-964d-4fd4-a450-2053a38a970a service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:06.132501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:06.133663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.134158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.134634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] PATH_INFO: `/v3/users/fc564035b8ee4029a9caced9064f69cb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.136469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc564035b8ee4029a9caced9064f69cb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:06.138590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:06.192182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc564035b8ee4029a9caced9064f69cb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.192831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc564035b8ee4029a9caced9064f69cb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.193419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc564035b8ee4029a9caced9064f69cb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.201146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc564035b8ee4029a9caced9064f69cb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.214557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-42d57f24-4669-4519-85e4-98710209150d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc564035b8ee4029a9caced9064f69cb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.228583 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1151/2289] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:06 2022] DELETE /identity/v3/users/fc564035b8ee4029a9caced9064f69cb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:06.442634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.461922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1174-f6bd-4464-9853-4c747a9ef14f service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:06.561291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:06.561964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.562813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.562813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] PATH_INFO: `/v3/projects/f800aa7badcb4386b3e23ca9b59cd886` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.563787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f800aa7badcb4386b3e23ca9b59cd886)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:06.565873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:06.626665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f800aa7badcb4386b3e23ca9b59cd886', 'request_id': 'req-c1d88b58-70cd-44a9-950d-6f790bbe149e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.633015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f800aa7badcb4386b3e23ca9b59cd886', 'request_id': 'req-c1d88b58-70cd-44a9-950d-6f790bbe149e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.642427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f800aa7badcb4386b3e23ca9b59cd886', 'request_id': 'req-c1d88b58-70cd-44a9-950d-6f790bbe149e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.657974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] The token cache is being invalidate because project f800aa7badcb4386b3e23ca9b59cd886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:06.658489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.659274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1d88b58-70cd-44a9-950d-6f790bbe149e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:06.661343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1139/2290] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:06 2022] DELETE /identity/v3/projects/f800aa7badcb4386b3e23ca9b59cd886 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:06.666100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.666571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.666845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.689429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:06.690619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:06.762385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1152/2291] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:06.770358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.770734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.771092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.791643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:06.793136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:06.801119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1140/2292] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:06.805621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.815971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dac560-e5d1-4d34-8887-3b3df5e6b8d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:06.821205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:06.821818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.822208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.822482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.823155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:06.823456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:06.825718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:06.827577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:06.839987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1153/2293] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:06.845054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.856238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c607b8-ee66-43f7-bac6-8ce47f480cbb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:06.861512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:06.862130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:06.862406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:06.862678 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:06.863288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:06.865276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:06.895038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1141/2294] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:06 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:29:06.899073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:06.910850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099835fe-574a-4fcf-8f6a-29638081c32e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:07.015021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:07.015768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.016096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.016413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.017050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:07.019043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:07.047822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1154/2295] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:06 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:07.051380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:07.062732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5ec58-5f9c-4537-a8ad-0eeaab848dc0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:07.070495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:07.071665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.072059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.072392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.073322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:07.075121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:07.086445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1142/2296] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:29:07.091524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:07.102430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba5b5-029c-4e30-b918-9f3ea75ccdf1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:07.109355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:07.109355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.109355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.109718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.110289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:07.111938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b126e8-32b2-44f8-a534-c64dd1d70c71 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:07.125523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1155/2297] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:29:07.129921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:07.140724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad866-3228-49a3-a3d2-acbd7358fc1d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:07.145738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:07.146411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.146751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.147085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] PATH_INFO: `/v3/projects/1a57cf70557045b8a0c5520d925bba6c/users/dadf472cd0bf4d8c80a76414875b0df9/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.163354 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a57cf70557045b8a0c5520d925bba6c, user_id=dadf472cd0bf4d8c80a76414875b0df9, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:07.166027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:07.180422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1143/2298] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:07 2022] PUT /identity/v3/projects/1a57cf70557045b8a0c5520d925bba6c/users/dadf472cd0bf4d8c80a76414875b0df9/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:07.195263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441f08-b21c-43ca-82e3-d5c6957315c4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.195547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441f08-b21c-43ca-82e3-d5c6957315c4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.195823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e441f08-b21c-43ca-82e3-d5c6957315c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.226152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0e441f08-b21c-43ca-82e3-d5c6957315c4 None None] MFA Rules not processed for user `dadf472cd0bf4d8c80a76414875b0df9`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:07.227498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e441f08-b21c-43ca-82e3-d5c6957315c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:07.314183 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1156/2299] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:07.321805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:07.323642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:07.338930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:07.407017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de8ec-10a3-4111-bcb3-fe7332ad892a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:07.413013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:07.413657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:07.413942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:07.414200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:07.424130 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:07.426252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:07.437752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1144/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:10.080875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e391-1971-4ac9-a572-872f384504f0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.081386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e391-1971-4ac9-a572-872f384504f0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.081386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119e391-1971-4ac9-a572-872f384504f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.101310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5119e391-1971-4ac9-a572-872f384504f0 None None] MFA Rules not processed for user `83cdff24514c42679e46d8f5b7c27fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:10.102506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5119e391-1971-4ac9-a572-872f384504f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.161342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:10.163950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1157/2301] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:10.224965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46f9f-882a-4cd2-8e43-c1dee371062c service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:10.230201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:10.230864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.231138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.231404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] PATH_INFO: `/v3/users/dadf472cd0bf4d8c80a76414875b0df9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.232546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadf472cd0bf4d8c80a76414875b0df9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:10.234470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:10.282631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadf472cd0bf4d8c80a76414875b0df9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.290830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadf472cd0bf4d8c80a76414875b0df9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.291470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadf472cd0bf4d8c80a76414875b0df9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.300290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadf472cd0bf4d8c80a76414875b0df9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.313066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadf472cd0bf4d8c80a76414875b0df9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.319492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1145/2302] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:10 2022] DELETE /identity/v3/users/dadf472cd0bf4d8c80a76414875b0df9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:10.324317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.324667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.325015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.337769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:10.344615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:10.346475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.408469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1158/2303] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:10.418974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:10.420438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.441739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:10.477718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:10.479548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.482149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f21647-0e31-45c7-885d-a4c3da87f99f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:10.486733 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:10.487481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.487742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.488060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.491849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911833c-cb36-42fa-8b02-c3e693792a45 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:10.495678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:10.496309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.496579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.496864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.498003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:10.498670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.499472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:10.508234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:10.508914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1146/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:10.509706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3d259-7026-4707-ba86-9a0d0791d714 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:10.518451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1159/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:10.792742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:10.794515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.809869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505bd84-c501-4ab8-b897-412fb8ccb097 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:10.816416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:10.817083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.817365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.817639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] PATH_INFO: `/v3/projects/1a57cf70557045b8a0c5520d925bba6c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.818894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a57cf70557045b8a0c5520d925bba6c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:10.820882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:10.874065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a57cf70557045b8a0c5520d925bba6c', 'request_id': 'req-8501bd37-be5c-46e9-ab7d-858d98486589'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.880358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a57cf70557045b8a0c5520d925bba6c', 'request_id': 'req-8501bd37-be5c-46e9-ab7d-858d98486589'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.889089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a57cf70557045b8a0c5520d925bba6c', 'request_id': 'req-8501bd37-be5c-46e9-ab7d-858d98486589'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.900037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] The token cache is being invalidate because project 1a57cf70557045b8a0c5520d925bba6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:10.900336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.900999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8501bd37-be5c-46e9-ab7d-858d98486589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:10.902623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1147/2306] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:10 2022] DELETE /identity/v3/projects/1a57cf70557045b8a0c5520d925bba6c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:10.907738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:10.908071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:10.908348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:10.929744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:10.931010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:10.995097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1160/2307] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:11.004291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.004582 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.004858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.025003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:11.026216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:11.034408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1148/2308] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:11.039102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.049634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a25a4-19c6-4ccc-9700-f3bbb5ffbe06 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.054609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.055265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.055506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.055775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.056511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:11.056818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.058718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.071179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1161/2309] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:29:11.075904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.091872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c09af-2ee6-446a-9961-5425bbc3d002 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.097731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.098344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.098619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.098896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.099516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.101635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.132876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1149/2310] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:11.137495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.148494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661383-1b7c-4576-9e08-879fc3e3d514 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.212568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.213276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.213640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.213888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.214590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.218604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.247337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1162/2311] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:29:11.251807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.262649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171a532-6c5f-4257-b3bf-c9664570f82d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.267670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.268325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.268614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.269011 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.269578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.271216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.282453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1150/2312] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:11.287055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.298341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d2c8c-d1cb-418a-ada8-5ccce6adb7cc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.303836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.304500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.304775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.305042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.305687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.307284 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b2d25-a6bb-45d4-8200-4a3f24151768 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.313573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:11.319470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1163/2313] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:29:11.324731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.335772 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77570330-83cc-4752-8f16-a9be71aaddb3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.340871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.341639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.341995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.342331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] PATH_INFO: `/v3/projects/4fd312d66a1b449eb72aa033df8bb6b4/users/bc27092bc5e5431ebdb4b7189f65f0dc/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.358039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd312d66a1b449eb72aa033df8bb6b4, user_id=bc27092bc5e5431ebdb4b7189f65f0dc, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.360904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.375206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1151/2314] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:11 2022] PUT /identity/v3/projects/4fd312d66a1b449eb72aa033df8bb6b4/users/bc27092bc5e5431ebdb4b7189f65f0dc/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:11.387650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.387869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.388176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.417816 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] MFA Rules not processed for user `bc27092bc5e5431ebdb4b7189f65f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:11.419522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:11.498874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1164/2315] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:11.503408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.546766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:11.566671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85cc2-20a2-4aea-a7b9-b5242a0e4ce4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.571371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.572009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.572285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.572600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.573234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.575205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.605191 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1152/2316] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:11.610146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.621309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786acddf-fa27-4ea6-a051-022fb21ef3bd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.676478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.677087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.677361 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.677623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.678273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.680228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.703114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1165/2317] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:29:11.707170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.717583 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed70052-cbb7-4b64-95b0-cd9b9cf7dd91 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.722200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.722808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.723083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.723382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.724053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.725681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.739341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1153/2318] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:11.743897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.754346 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9fb8ac-da4c-4979-a0a3-8de0ffe94b60 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.759329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.760031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.760313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.760586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] PATH_INFO: `/v3/projects/d400ee7d4a804147bb858c9f8c725ad2/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.776638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d400ee7d4a804147bb858c9f8c725ad2, user_id=8a64e4ab1c2e4f2d9ff5a2d805b22c6c, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.779445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.794886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1166/2319] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:11 2022] PUT /identity/v3/projects/d400ee7d4a804147bb858c9f8c725ad2/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:29:11.799016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.811039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c9ea4-4133-41f2-b453-6a86acda0227 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.869802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.870427 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.870746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.871181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.871819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.873481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783c632-a9ca-4874-bdd9-cc9d0ebba3dd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.883478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1154/2320] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:11.888085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:11.899530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd223202-237d-4579-8442-552f79cad4b4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:11.904658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:11.906759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.906759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.906759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] PATH_INFO: `/v3/projects/d400ee7d4a804147bb858c9f8c725ad2/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.908206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d400ee7d4a804147bb858c9f8c725ad2, user_id=8a64e4ab1c2e4f2d9ff5a2d805b22c6c, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:11.910830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:11.921916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1167/2321] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:11 2022] PUT /identity/v3/projects/d400ee7d4a804147bb858c9f8c725ad2/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:11.933928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:11.934208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:11.934481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:11.964151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] MFA Rules not processed for user `8a64e4ab1c2e4f2d9ff5a2d805b22c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:11.965868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:12.047978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1155/2322] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:12.060099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:12.062443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:12.111712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:12.125311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074bd17-50ea-409d-95cd-75bd139b94f0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:12.128936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:12.129541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:12.129815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:12.130090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:12.139449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:12.140927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7c428-4491-44a7-b906-58735b966ec1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:12.150605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1168/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:12.625069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:12.666954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:12.690987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6991ce-4196-4278-bc9e-17acd7665c65 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:12.695505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:12.696171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:12.696501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:12.696712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] PATH_INFO: `/v3/users/bc27092bc5e5431ebdb4b7189f65f0dc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:12.698010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc27092bc5e5431ebdb4b7189f65f0dc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:12.700390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:12.753856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc27092bc5e5431ebdb4b7189f65f0dc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:12.763021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc27092bc5e5431ebdb4b7189f65f0dc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:12.763705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc27092bc5e5431ebdb4b7189f65f0dc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:12.771165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc27092bc5e5431ebdb4b7189f65f0dc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:12.784168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc27092bc5e5431ebdb4b7189f65f0dc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:12.790501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1156/2324] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:12 2022] DELETE /identity/v3/users/bc27092bc5e5431ebdb4b7189f65f0dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:29:12.795371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:12.795654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:12.796012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:12.816141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:12.817394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:12.880858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1169/2325] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:12.891018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:12.892510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:12.950597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73777704-4c34-4f5a-a6fc-7aa648e85b4b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:12.954643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:12.955257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:12.955534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:12.955798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:12.965504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:12.966940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:12.976435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1157/2326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:13.474442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:13.476144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:13.503965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30b43-6bc8-45e1-bee0-42dae33430b8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:13.518838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:13.519603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:13.519788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:13.520484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] PATH_INFO: `/v3/projects/4fd312d66a1b449eb72aa033df8bb6b4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:13.521746 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd312d66a1b449eb72aa033df8bb6b4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:13.523664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:13.575053 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd312d66a1b449eb72aa033df8bb6b4', 'request_id': 'req-6c575ee3-26f8-4459-9aee-2fb3033c8169'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.583201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd312d66a1b449eb72aa033df8bb6b4', 'request_id': 'req-6c575ee3-26f8-4459-9aee-2fb3033c8169'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.590821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd312d66a1b449eb72aa033df8bb6b4', 'request_id': 'req-6c575ee3-26f8-4459-9aee-2fb3033c8169'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.602327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] The token cache is being invalidate because project 4fd312d66a1b449eb72aa033df8bb6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:13.602618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.603263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.605371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1170/2327] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:13 2022] DELETE /identity/v3/projects/4fd312d66a1b449eb72aa033df8bb6b4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:13.609409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:13.619559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7c3d4-840c-4768-89a7-f04d375cea0e service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:13.675577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:13.682785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:13.683686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:13.684398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:13.685183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] PATH_INFO: `/v3/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:13.686563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a64e4ab1c2e4f2d9ff5a2d805b22c6c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:13.688517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:13.750741 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a64e4ab1c2e4f2d9ff5a2d805b22c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.760258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a64e4ab1c2e4f2d9ff5a2d805b22c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.760928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a64e4ab1c2e4f2d9ff5a2d805b22c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.769371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a64e4ab1c2e4f2d9ff5a2d805b22c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.782306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-974d37af-9717-4985-91d2-298e0e733317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a64e4ab1c2e4f2d9ff5a2d805b22c6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:13.789032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1158/2328] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:13 2022] DELETE /identity/v3/users/8a64e4ab1c2e4f2d9ff5a2d805b22c6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:14.202403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.204291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:14.219601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c575ee3-26f8-4459-9aee-2fb3033c8169 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.284380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.285221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.285492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.285763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] PATH_INFO: `/v3/projects/d400ee7d4a804147bb858c9f8c725ad2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.286995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d400ee7d4a804147bb858c9f8c725ad2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.288962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.300872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:14.345089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd400ee7d4a804147bb858c9f8c725ad2', 'request_id': 'req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:14.357497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd400ee7d4a804147bb858c9f8c725ad2', 'request_id': 'req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:14.368052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd400ee7d4a804147bb858c9f8c725ad2', 'request_id': 'req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:14.385945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] The token cache is being invalidate because project d400ee7d4a804147bb858c9f8c725ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:14.386499 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:14.387465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9df68d6e-d23e-4e86-ba9e-0280d2e41bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:14.393141 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1171/2329] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:14 2022] DELETE /identity/v3/projects/d400ee7d4a804147bb858c9f8c725ad2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:14.394045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.394332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.395008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.416288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:14.417971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:14.485754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1159/2330] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:14.493972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.494518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.494518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.518324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:14.519524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:14.527856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1172/2331] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:14.531986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.544705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14de83e-43e7-4334-8aa4-882fdbcdacfb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.549476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.550071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.550344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.550873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.551656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:14.552044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.553628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.566303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1160/2332] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:14.571019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.581791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703b05-f864-47e1-a7d0-f969a4714ba5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.586677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.587297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.587573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.587839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.588501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.590806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.622341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1173/2333] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:14.626766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.638273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e45d28-f07d-4a71-a33c-510674bc4504 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.702571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.703308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.703449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.703743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.704514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.706867 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.719500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:14.737592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1161/2334] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:29:14.742900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.753964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1b92f-88eb-4c43-bf5b-4dcc6eee640a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.758792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.759391 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.759665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.759955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.760594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.762507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.772252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1174/2335] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:14.776188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.786314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef40cd-f954-42d9-af4e-8653eba96261 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.790916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.791515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.791791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.792170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.792823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.794435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b91832-0c4e-4836-bc12-8b603e75440b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.805268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1162/2336] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:14.809526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:14.825575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05758c-d5a9-4572-9a86-9796d28702f0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:14.834493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:14.835412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.835732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.836134 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] PATH_INFO: `/v3/projects/ba90a3186ff54cf5a6a6bb06134beff1/users/0c5689b0d52246f1b824a52a44262193/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.852340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba90a3186ff54cf5a6a6bb06134beff1, user_id=0c5689b0d52246f1b824a52a44262193, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:14.855555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:14.870736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1175/2337] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:14 2022] PUT /identity/v3/projects/ba90a3186ff54cf5a6a6bb06134beff1/users/0c5689b0d52246f1b824a52a44262193/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:14.880993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:14.881267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:14.881519 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:14.910269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] MFA Rules not processed for user `0c5689b0d52246f1b824a52a44262193`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:14.911516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:14.987906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1163/2338] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:14.992794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.057604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca039b99-0678-4a2b-9ac1-4cb862e190bb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.062948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.063564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.063842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.064145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.064767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.066674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.099655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1176/2339] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:14 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:15.103814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.115202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f90f8-76e3-4f5a-8467-b197c3f431fb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.175623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.176266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.176542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.176805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.177420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.179359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.202428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1164/2340] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:15 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:15.206765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.217469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428277-2ebb-41c9-a92f-47b81281def7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.222331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.222924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.223200 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.223468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.224151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.225844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.236989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1177/2341] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:15.241141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.254351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24f8a-0b4c-48d8-be3e-06048d829935 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.261166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.262246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.262530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.262799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] PATH_INFO: `/v3/projects/fd405350edac4fd2b437c5cba6ab8c96/users/39e7d1776e8a406ebaf44cbd262e8d72/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.278640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd405350edac4fd2b437c5cba6ab8c96, user_id=39e7d1776e8a406ebaf44cbd262e8d72, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.281379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.298486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1165/2342] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:15 2022] PUT /identity/v3/projects/fd405350edac4fd2b437c5cba6ab8c96/users/39e7d1776e8a406ebaf44cbd262e8d72/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:15.302571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.313283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719446-788f-422a-ad38-a8f87b04b7f4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.317842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:15.374190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.374784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.375061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.375327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.375958 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.377570 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6ba7c-c596-494e-ac9b-e8c96868a044 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.388450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1178/2343] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:15.393161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.404316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ab979-f7f7-47b4-97ce-573759c33024 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.410096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.410777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.411050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.411316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] PATH_INFO: `/v3/projects/fd405350edac4fd2b437c5cba6ab8c96/users/39e7d1776e8a406ebaf44cbd262e8d72/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.413547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd405350edac4fd2b437c5cba6ab8c96, user_id=39e7d1776e8a406ebaf44cbd262e8d72, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.416201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.426814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1166/2344] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:15 2022] PUT /identity/v3/projects/fd405350edac4fd2b437c5cba6ab8c96/users/39e7d1776e8a406ebaf44cbd262e8d72/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:15.439005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.439291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.439559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.468002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] MFA Rules not processed for user `39e7d1776e8a406ebaf44cbd262e8d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:15.469224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:15.546151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1179/2345] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:15.557474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:15.559674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:15.590209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:15.633965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de3cbe-3869-467f-acc1-c4b72798f068 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:15.638687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:15.639318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:15.639593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:15.639864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:15.707442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:15.709083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:15.719845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1167/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:18.311384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:18.320932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da94ce-f25e-4bf8-847d-a5fac91c44da None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:18.324556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:18.325148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:18.325419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:18.325682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:18.334375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:18.335791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389dcce-d78c-40fc-b730-a5594f469bfa service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:18.345713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1180/2347] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:25.714414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=37 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:28.341737 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=65 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:31.063797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:31.130336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2b031-aeae-4108-9fca-dd134e2e1914 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:31.136075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:31.136713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:31.136991 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:31.137258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] PATH_INFO: `/v3/users/0c5689b0d52246f1b824a52a44262193` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:31.138529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5689b0d52246f1b824a52a44262193)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:31.140577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:31.196937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5689b0d52246f1b824a52a44262193'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.208142 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5689b0d52246f1b824a52a44262193'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.209086 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5689b0d52246f1b824a52a44262193'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.218828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5689b0d52246f1b824a52a44262193'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.236783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5689b0d52246f1b824a52a44262193'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.246622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1168/2348] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:31 2022] DELETE /identity/v3/users/0c5689b0d52246f1b824a52a44262193 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:31.251712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:31.252298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:31.252298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:31.272575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:31.273809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:31.337714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1181/2349] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:31.350872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:31.352732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:31.416429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfd8f9-ac5f-429e-a725-f965b939a889 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:31.421271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:31.421877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:31.422150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:31.422416 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:31.438586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:31.440974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:31.455207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1169/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:31.752631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:31.754326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:31.768718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058ca5-0f86-4be7-ae82-698a52d8df97 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:31.774281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:31.774916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:31.775185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:31.775459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] PATH_INFO: `/v3/projects/ba90a3186ff54cf5a6a6bb06134beff1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:31.776600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba90a3186ff54cf5a6a6bb06134beff1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:31.778516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:31.824858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba90a3186ff54cf5a6a6bb06134beff1', 'request_id': 'req-28425b7c-a4c2-4bdd-8319-bec3345576f7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.833229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba90a3186ff54cf5a6a6bb06134beff1', 'request_id': 'req-28425b7c-a4c2-4bdd-8319-bec3345576f7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.839934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba90a3186ff54cf5a6a6bb06134beff1', 'request_id': 'req-28425b7c-a4c2-4bdd-8319-bec3345576f7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.851755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] The token cache is being invalidate because project ba90a3186ff54cf5a6a6bb06134beff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:31.852140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.852837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.854636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1182/2351] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:31 2022] DELETE /identity/v3/projects/ba90a3186ff54cf5a6a6bb06134beff1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:31.860862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:31.875045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c18ed4-0c6f-4d24-aee0-9864ae3bbb9b service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:31.894598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:31.936754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:31.937396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:31.937670 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:31.937942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] PATH_INFO: `/v3/users/39e7d1776e8a406ebaf44cbd262e8d72` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:31.939127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e7d1776e8a406ebaf44cbd262e8d72)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:31.941172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:31.990284 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e7d1776e8a406ebaf44cbd262e8d72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:31.999605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e7d1776e8a406ebaf44cbd262e8d72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.000228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e7d1776e8a406ebaf44cbd262e8d72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.007782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e7d1776e8a406ebaf44cbd262e8d72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.020068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23e48d64-411c-4248-b7cf-cac9e113b596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e7d1776e8a406ebaf44cbd262e8d72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.026026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1170/2352] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:31 2022] DELETE /identity/v3/users/39e7d1776e8a406ebaf44cbd262e8d72 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:32.320232 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.322864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:32.340293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28425b7c-a4c2-4bdd-8319-bec3345576f7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.401434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.401996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.402270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.402539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] PATH_INFO: `/v3/projects/fd405350edac4fd2b437c5cba6ab8c96` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.403703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd405350edac4fd2b437c5cba6ab8c96)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.405680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.439138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:32.457427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd405350edac4fd2b437c5cba6ab8c96', 'request_id': 'req-4f2cb192-57ee-4c17-973d-21f6100f777a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.465839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd405350edac4fd2b437c5cba6ab8c96', 'request_id': 'req-4f2cb192-57ee-4c17-973d-21f6100f777a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.472635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd405350edac4fd2b437c5cba6ab8c96', 'request_id': 'req-4f2cb192-57ee-4c17-973d-21f6100f777a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.484678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] The token cache is being invalidate because project fd405350edac4fd2b437c5cba6ab8c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:32.484970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.485654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f2cb192-57ee-4c17-973d-21f6100f777a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:32.487172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1183/2353] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:32 2022] DELETE /identity/v3/projects/fd405350edac4fd2b437c5cba6ab8c96 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:32.492431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.492918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.493046 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.513776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:32.515956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:32.590125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1171/2354] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:32.598146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.598428 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.598723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.621280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:32.622516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:32.632880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1184/2355] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:32.638054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.648539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebadad2-f8e8-4067-90df-b718096e3e29 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.654251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.654838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.655120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.655390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.656069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:32.656374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.657996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.671139 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1172/2356] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:32.677339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.687574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355723e-e78a-4272-b8a1-7362c458b791 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.693700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.694299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.694577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.694842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.695456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.697378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.726689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1185/2357] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:32 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:32.731342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.743266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4422857-d2e9-4dd6-9a35-9ecf62aa89a3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.777790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:32.810105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.810854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.811134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.811407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.812085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.814014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.835428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1173/2358] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:32 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:32.839805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.851264 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2de75-93d4-4668-8364-e8a87d8024c8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.857344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.858029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.858296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.858562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.859205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.860846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.871136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1186/2359] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:32.876010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.890720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a2e7c-a934-4003-a40d-5b13f6ae25d6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.896572 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.897167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.897425 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.897690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.898330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.899962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c406-6e66-44e6-96fb-9e36a5f37f06 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.910420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1174/2360] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:32.914471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:32.925611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847cc4e-6f33-4907-8332-d4531a812648 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:32.930398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:32.931024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.931307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.931580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] PATH_INFO: `/v3/projects/b4cc9f1a2d99402dade2164275a249ed/users/d6a661d03d9c455d8ce942bf2901fa41/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:32.946320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cc9f1a2d99402dade2164275a249ed, user_id=d6a661d03d9c455d8ce942bf2901fa41, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:32.949096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:32.962915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1187/2361] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:32 2022] PUT /identity/v3/projects/b4cc9f1a2d99402dade2164275a249ed/users/d6a661d03d9c455d8ce942bf2901fa41/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:29:32.974760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:32.975043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:32.975313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.004809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] MFA Rules not processed for user `d6a661d03d9c455d8ce942bf2901fa41`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:33.006032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:33.078746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1175/2362] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:33.083728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.149713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b818224-4d32-4b45-b7f4-61ba600f9a29 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.155842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.156771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.157093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.157436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.158338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.161411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.197978 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1188/2363] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:33 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:33.202366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.213897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a7d2d-6431-482f-953d-ce4a74e06b6b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.279040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.279710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.280000 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.280419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.281050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.282978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.308665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1176/2364] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:33 2022] POST /identity/v3/users => generated 306 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:33.313186 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.324191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e5004-69dc-4795-9413-7315e5c4dc0f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.329750 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.330362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.330646 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.330916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.331564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.333773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.346530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1189/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:29:33.350929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.363308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66eaa78-0fc3-4edc-af75-046eb018e356 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.368724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.369470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.369632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.369938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] PATH_INFO: `/v3/projects/2597d45f511841518265adec64607b88/users/0834ace14e404da6976b46b0a007cc01/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.388363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2597d45f511841518265adec64607b88, user_id=0834ace14e404da6976b46b0a007cc01, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.391429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.408866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1177/2366] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:33 2022] PUT /identity/v3/projects/2597d45f511841518265adec64607b88/users/0834ace14e404da6976b46b0a007cc01/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:33.413256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.426971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9d7c-1f0d-48da-bc9b-bfe3660484e8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.450898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:33.489102 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.489718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.489990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.490256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.490889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.492507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477fec8-12df-4f00-96c5-9b3faf4e712d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.502893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1190/2367] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:33.507397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.513179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:33.519822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1680836-1791-490e-b295-9e43d3717f89 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.525107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.525813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.526093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.526380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] PATH_INFO: `/v3/projects/2597d45f511841518265adec64607b88/users/0834ace14e404da6976b46b0a007cc01/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.528396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2597d45f511841518265adec64607b88, user_id=0834ace14e404da6976b46b0a007cc01, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.531116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.541701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1178/2368] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:33 2022] PUT /identity/v3/projects/2597d45f511841518265adec64607b88/users/0834ace14e404da6976b46b0a007cc01/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:33.553222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.553511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.553780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.583025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] MFA Rules not processed for user `0834ace14e404da6976b46b0a007cc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:33.584270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:33.658836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1191/2369] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:33.672953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.674739 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:33.744040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88eacd9-e750-436a-91ec-2b432c125036 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.748103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.748762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.749050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.749344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.759323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.760821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.770303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1179/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:33.857366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:33.867714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf59d7-8cb3-4cca-a2f6-3f5d89bc98d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:33.872307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:33.872910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:33.873181 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:33.873449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:33.935531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:33.937125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8744ee-e2f5-446a-97f9-807bb60f8728 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:33.946789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1192/2371] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:38.125713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:38.193951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2469244-5256-490a-a660-1cdaae7d27c4 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:38.199351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:38.200036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:38.200312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:38.200578 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] PATH_INFO: `/v3/users/d6a661d03d9c455d8ce942bf2901fa41` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:38.201790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a661d03d9c455d8ce942bf2901fa41)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:38.203730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:38.253700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a661d03d9c455d8ce942bf2901fa41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.261180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a661d03d9c455d8ce942bf2901fa41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.261839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a661d03d9c455d8ce942bf2901fa41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.268924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a661d03d9c455d8ce942bf2901fa41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.280341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a661d03d9c455d8ce942bf2901fa41'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.286083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1180/2372] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:38 2022] DELETE /identity/v3/users/d6a661d03d9c455d8ce942bf2901fa41 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:38.290712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:38.291222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:38.291332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:38.312045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:38.313326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:38.356731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:38.378272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1193/2373] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:38.388215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:38.389787 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:38.403951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:38.452253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbea80d-40eb-48e1-9cfb-9245ec48f788 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:38.456629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:38.457298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:38.457574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:38.457843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:38.467349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:38.468815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:38.478639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1181/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:38.770793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:38.772468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:38.785203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6a239-261a-47ff-bc46-8a87cf33d4f4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:38.794409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:38.795064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:38.795394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:38.795597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] PATH_INFO: `/v3/projects/b4cc9f1a2d99402dade2164275a249ed` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:38.797009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cc9f1a2d99402dade2164275a249ed)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:38.799055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:38.858576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cc9f1a2d99402dade2164275a249ed', 'request_id': 'req-27086312-90b9-41c6-b284-541e0c858437'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.869080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cc9f1a2d99402dade2164275a249ed', 'request_id': 'req-27086312-90b9-41c6-b284-541e0c858437'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.875691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cc9f1a2d99402dade2164275a249ed', 'request_id': 'req-27086312-90b9-41c6-b284-541e0c858437'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.887803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] The token cache is being invalidate because project b4cc9f1a2d99402dade2164275a249ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:38.888112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.888773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:38.890270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1194/2375] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:38 2022] DELETE /identity/v3/projects/b4cc9f1a2d99402dade2164275a249ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:38.894479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:38.904429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a83ef-7ddf-4687-a62d-49bf4129faeb service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:38.967346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:38.967893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:38.968221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:38.968493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] PATH_INFO: `/v3/users/0834ace14e404da6976b46b0a007cc01` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:38.969680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0834ace14e404da6976b46b0a007cc01)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:38.971627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.019369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0834ace14e404da6976b46b0a007cc01'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.027794 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0834ace14e404da6976b46b0a007cc01'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.028426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0834ace14e404da6976b46b0a007cc01'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.036272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0834ace14e404da6976b46b0a007cc01'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.048664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-186d117e-7057-4781-a218-2eb40e6461c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0834ace14e404da6976b46b0a007cc01'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.054983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1182/2376] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:38 2022] DELETE /identity/v3/users/0834ace14e404da6976b46b0a007cc01 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:39.343119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.344752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:39.358325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086312-90b9-41c6-b284-541e0c858437 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.414618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.415341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.415610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.415884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] PATH_INFO: `/v3/projects/2597d45f511841518265adec64607b88` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.417117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2597d45f511841518265adec64607b88)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.419007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.468418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2597d45f511841518265adec64607b88', 'request_id': 'req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.478694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2597d45f511841518265adec64607b88', 'request_id': 'req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.485673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2597d45f511841518265adec64607b88', 'request_id': 'req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.491705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:39.496535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] The token cache is being invalidate because project 2597d45f511841518265adec64607b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:39.496837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.497600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f69e3e4a-fea4-486a-b1b4-5ec19faa636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:39.499420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1195/2377] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:39 2022] DELETE /identity/v3/projects/2597d45f511841518265adec64607b88 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:39.506038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.506534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.506630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.527083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:39.528297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:39.558041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:39.591648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1183/2378] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:39.599953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.600271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.600539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.621285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:39.622474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:39.631001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1196/2379] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:39.635469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.646351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524cf20-d47b-4904-8506-5ff5eae2540d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.652332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.652933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.653207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.653471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.654120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:39.654419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.656044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.667696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1184/2380] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:39.672251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.681915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8eae1-9ce3-432f-be6f-1ed79f6bd368 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.687740 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.688628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.689100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.689385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.689988 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.691946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.722006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1197/2381] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:39 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:39.726179 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.737691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bc60-12e8-4767-b8a1-2b199b430c08 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.797788 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.798371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.798629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.798892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.799514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.801452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.824321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1185/2382] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:39 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:39.828650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.840537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d31a72-b74f-4c85-b65e-bae7c215c7a2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.845955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.846576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.846853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.847122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.847769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.849444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.860501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1198/2383] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:39.864764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.875540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803482-84ef-4167-aa5d-a2453525c23a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.881862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.882471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.882751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.883017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.883662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.885323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f521-ad68-4b5d-896c-b5011ce7850f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.896818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1186/2384] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:39.901205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:39.913127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7bec6-f207-4d56-8cb8-d9f2d543ce3b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:39.920279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:39.921158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.921554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.921824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] PATH_INFO: `/v3/projects/066a11c0b98b447aa26cf4a50819bc62/users/d9530b8860d94f039e830a49bdf60626/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:39.939112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] RBAC: Authorizing `identity:create_grant(project_id=066a11c0b98b447aa26cf4a50819bc62, user_id=d9530b8860d94f039e830a49bdf60626, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:39.941831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:39.957464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1199/2385] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:39 2022] PUT /identity/v3/projects/066a11c0b98b447aa26cf4a50819bc62/users/d9530b8860d94f039e830a49bdf60626/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:39.970034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:39.970398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:39.970683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.004684 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] MFA Rules not processed for user `d9530b8860d94f039e830a49bdf60626`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:40.005878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:40.071034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1187/2386] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:40.075999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.138757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7dc7-3e43-4feb-aafe-1b9865a7417c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.144857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.145503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.145777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.146047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.146682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.148705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.184049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1200/2387] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:40 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:40.189634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.209406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a842b06-10ab-41df-9604-6a9f7e2be97e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.239428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:40.279934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.280803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.281081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.281350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.282225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.285082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.315114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1188/2388] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:40 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:40.321606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.334224 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45b8b1-e741-4d82-961b-d68fd7986eb2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.340212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.340815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.341094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.341363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.342018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.343631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.355852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1201/2389] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:40.360362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.370940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb72b7-2a4a-4720-aa5b-b2019fe8be57 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.376948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.377632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.377902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.378169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] PATH_INFO: `/v3/projects/c8d958cf8f1340da930862129f3a4ecc/users/cc32d4e09f3542afa269cc154f3bbd7c/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.393761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d958cf8f1340da930862129f3a4ecc, user_id=cc32d4e09f3542afa269cc154f3bbd7c, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.396535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.412962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1189/2390] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:40 2022] PUT /identity/v3/projects/c8d958cf8f1340da930862129f3a4ecc/users/cc32d4e09f3542afa269cc154f3bbd7c/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:29:40.417138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.427781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8386442-927e-4083-9648-bc50bbfc2e64 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.489414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.490019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.490301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.490568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.491214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.492841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843629-d6df-4225-8999-f56f024277c9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.502942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1202/2391] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:29:40.507410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.519006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cca59-1b63-48f9-bdd6-0ec4529c26eb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.524940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.525612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.525913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.526166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] PATH_INFO: `/v3/projects/c8d958cf8f1340da930862129f3a4ecc/users/cc32d4e09f3542afa269cc154f3bbd7c/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.528443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d958cf8f1340da930862129f3a4ecc, user_id=cc32d4e09f3542afa269cc154f3bbd7c, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.531127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.542351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1190/2392] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:40 2022] PUT /identity/v3/projects/c8d958cf8f1340da930862129f3a4ecc/users/cc32d4e09f3542afa269cc154f3bbd7c/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:40.553019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.553311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.553587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.562032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:40.583687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] MFA Rules not processed for user `cc32d4e09f3542afa269cc154f3bbd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:40.585426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:40.666505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1203/2393] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:40.679058 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.681998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:40.747486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2319-c981-4701-a425-2f7c9e50dda0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.751585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.752241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.752516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.752781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.761939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.763360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.772892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1191/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:40.865635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:40.875723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2285c-9fe4-4e6c-8e4e-0dd76360ac30 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:40.880050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:40.880649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:40.881161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:40.881437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:40.941974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:40.943406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312362bb-d9cf-4f61-9203-c6ba00ce4eb0 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:40.952492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1204/2395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:45.796822 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:45.870098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dae09-d37c-4362-85d9-3b095175909b service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:45.877883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:45.878548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:45.878823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:45.879088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] PATH_INFO: `/v3/users/d9530b8860d94f039e830a49bdf60626` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:45.880388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9530b8860d94f039e830a49bdf60626)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:45.882358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:45.911608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:45.931970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9530b8860d94f039e830a49bdf60626'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:45.940918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9530b8860d94f039e830a49bdf60626'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:45.941562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9530b8860d94f039e830a49bdf60626'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:45.948520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9530b8860d94f039e830a49bdf60626'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:45.960800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9530b8860d94f039e830a49bdf60626'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:45.966717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1192/2396] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:45 2022] DELETE /identity/v3/users/d9530b8860d94f039e830a49bdf60626 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:45.971613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:45.972128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:45.972240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:45.992212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:45.993431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:46.056296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1205/2397] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:46.066222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:46.067933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:46.135370 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b78f4-fc73-40c7-878c-3402fa56f8dc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:46.142386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:46.142998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:46.143272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:46.143542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:46.154275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:46.155738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:46.165599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1193/2398] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:46.442488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:46.443962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:46.456049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78820e-8151-4bf1-aff8-dec8ebe678f4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:46.461071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:46.461705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:46.461974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:46.462212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] PATH_INFO: `/v3/projects/066a11c0b98b447aa26cf4a50819bc62` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:46.463382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066a11c0b98b447aa26cf4a50819bc62)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:46.465314 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:46.491497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:46.515520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066a11c0b98b447aa26cf4a50819bc62', 'request_id': 'req-bd729aaa-1941-4b4f-a6fb-08cf051ca238'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.523976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066a11c0b98b447aa26cf4a50819bc62', 'request_id': 'req-bd729aaa-1941-4b4f-a6fb-08cf051ca238'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.530312 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066a11c0b98b447aa26cf4a50819bc62', 'request_id': 'req-bd729aaa-1941-4b4f-a6fb-08cf051ca238'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.541443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] The token cache is being invalidate because project 066a11c0b98b447aa26cf4a50819bc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:46.541722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.542390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.544216 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1206/2399] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:46 2022] DELETE /identity/v3/projects/066a11c0b98b447aa26cf4a50819bc62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:46.548461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:46.559550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6026ab-2b46-480d-839e-e301781b78b6 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:46.624061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:46.624713 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:46.624988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:46.625253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] PATH_INFO: `/v3/users/cc32d4e09f3542afa269cc154f3bbd7c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:46.626641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc32d4e09f3542afa269cc154f3bbd7c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:46.628483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:46.677442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc32d4e09f3542afa269cc154f3bbd7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.679198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:46.687269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc32d4e09f3542afa269cc154f3bbd7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.688581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc32d4e09f3542afa269cc154f3bbd7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.696207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc32d4e09f3542afa269cc154f3bbd7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.708194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1180215f-82ec-430d-b4ec-61445259e2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc32d4e09f3542afa269cc154f3bbd7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:46.714890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1194/2400] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:46 2022] DELETE /identity/v3/users/cc32d4e09f3542afa269cc154f3bbd7c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:47.014462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.016051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:47.029580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729aaa-1941-4b4f-a6fb-08cf051ca238 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.087242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.087793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.088099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.088363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] PATH_INFO: `/v3/projects/c8d958cf8f1340da930862129f3a4ecc` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.089561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d958cf8f1340da930862129f3a4ecc)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.091443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.138100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d958cf8f1340da930862129f3a4ecc', 'request_id': 'req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:47.146228 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d958cf8f1340da930862129f3a4ecc', 'request_id': 'req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:47.152522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d958cf8f1340da930862129f3a4ecc', 'request_id': 'req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:47.162651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] The token cache is being invalidate because project c8d958cf8f1340da930862129f3a4ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:47.162929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:47.163554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e48cb431-f6a2-45a5-9b70-a8b8dee8f7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:47.165068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1207/2401] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:47 2022] DELETE /identity/v3/projects/c8d958cf8f1340da930862129f3a4ecc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:47.171736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.172265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.172364 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.192796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:47.194023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:47.257844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1195/2402] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:47.266848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.267122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.267479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.290479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:47.291773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:47.302055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1208/2403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:47.306585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.317244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846faa6-179f-4c73-a46c-800aca308604 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.321780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.322389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.322707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.322973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.323637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:47.323951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.325581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.338241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1196/2404] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:47.343130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.353417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b6589-3e68-4d28-ae21-e7616188a255 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.358891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.359501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.359806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.360111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.360758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.362676 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.391821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1209/2405] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:47.395859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.406417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76035c02-f3ab-4e02-b01c-857a36b6dcae admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.471274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.471881 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.472187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.472457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.473115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.475082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.504083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1197/2406] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:47.513798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.525172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feaa57-1576-4c28-9ba1-8e885b845177 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.530126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.530730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.531007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.531279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.531903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.533549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.543837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1210/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:47.548598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.558782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ff19-4a2c-41f2-9791-2910a2d7e0b4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.563501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.564147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.564448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.564716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.565361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.566972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b354474-aa09-42a8-936a-3a35273cc2a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.577705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1198/2408] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:47.582389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.587883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:47.595251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eadbe-2ef1-4b15-ade6-897e24d3d0d7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.602114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.603169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.603448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.603726 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] PATH_INFO: `/v3/projects/262d69dfeffa4f08a64e3eaf60369fd0/users/cb61d6d7388c4c40abf2930dbae7acc9/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.619707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] RBAC: Authorizing `identity:create_grant(project_id=262d69dfeffa4f08a64e3eaf60369fd0, user_id=cb61d6d7388c4c40abf2930dbae7acc9, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.622426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.639810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1211/2409] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:47 2022] PUT /identity/v3/projects/262d69dfeffa4f08a64e3eaf60369fd0/users/cb61d6d7388c4c40abf2930dbae7acc9/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:47.708573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.708967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.709449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.748769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] MFA Rules not processed for user `cb61d6d7388c4c40abf2930dbae7acc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:47.750003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:47.769475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:47.822043 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1199/2410] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:47.826962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.895626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e4155-f307-4cdc-9500-98e2c239286d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:47.901057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:47.901667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:47.901949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:47.902220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:47.902848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:47.904804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:47.939509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1212/2411] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:47.946624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:47.959742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ab906-8226-4efb-87d4-fc06ecf5660d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.019388 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.020015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.020294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.020579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.021222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.023167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.046683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1200/2412] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:47 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:48.050813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:48.061404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ee13-7d09-40db-9bce-e622713f9677 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.066306 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.066908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.067182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.067452 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.068123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.069721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.080373 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1213/2413] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:48.084595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:48.095181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd8c68-c970-4b5f-8437-6861e68791cb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.101261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.101922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.102560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.102838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] PATH_INFO: `/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2/users/b8de83b355554492a3a2bf3a004e3252/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.119983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d6e708bb664bd0aaad97712bd3d9a2, user_id=b8de83b355554492a3a2bf3a004e3252, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.122674 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.137968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1201/2414] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:48 2022] PUT /identity/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2/users/b8de83b355554492a3a2bf3a004e3252/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:48.142660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:48.158814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c78b-90d0-463e-9213-bbccd69904a8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.217210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.217833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.218107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.218386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.219033 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.223100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934af20-dbaa-440d-91aa-fdd9a0c4371b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.233483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1214/2415] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:48.238255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:48.248931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c552-e638-4aa7-a1ae-d365150798c4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.254174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.254823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.255104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.255369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] PATH_INFO: `/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2/users/b8de83b355554492a3a2bf3a004e3252/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.257348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d6e708bb664bd0aaad97712bd3d9a2, user_id=b8de83b355554492a3a2bf3a004e3252, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.260020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.270574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1202/2416] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:48 2022] PUT /identity/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2/users/b8de83b355554492a3a2bf3a004e3252/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:48.281454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.281742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.281998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.313579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] MFA Rules not processed for user `b8de83b355554492a3a2bf3a004e3252`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:48.314813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:48.354064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:48.384792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1215/2417] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:48.396329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:48.398640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:48.462922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819667-ffc1-4237-9038-f31c5a358cc5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:48.467765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:48.468511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:48.468805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:48.469094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:48.480192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:48.481676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba8e4-fc84-4066-89fd-7c467f3273f7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:48.491423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1203/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:48.945585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:49.013865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c60fc-25cd-42cb-a090-8d614deaab55 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:49.020172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:49.020788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:49.021058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:49.021322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] PATH_INFO: `/v3/users/cb61d6d7388c4c40abf2930dbae7acc9` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:49.022567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb61d6d7388c4c40abf2930dbae7acc9)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:49.024550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:49.073353 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb61d6d7388c4c40abf2930dbae7acc9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.074121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb61d6d7388c4c40abf2930dbae7acc9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.075213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb61d6d7388c4c40abf2930dbae7acc9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.084785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb61d6d7388c4c40abf2930dbae7acc9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.104728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb61d6d7388c4c40abf2930dbae7acc9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.125550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1216/2419] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:48 2022] DELETE /identity/v3/users/cb61d6d7388c4c40abf2930dbae7acc9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:49.127601 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b58f3-189a-4461-8304-71e139641971 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:49.127851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b58f3-189a-4461-8304-71e139641971 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:49.128149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b58f3-189a-4461-8304-71e139641971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:49.151057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f32b58f3-189a-4461-8304-71e139641971 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:49.153076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f32b58f3-189a-4461-8304-71e139641971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:49.167141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:49.222691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1204/2420] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:49.236488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:49.238956 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:49.307863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2326-312a-4e72-ba3b-431d87569709 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:49.311511 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:49.312179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:49.312449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:49.312714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:49.320404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:49.323129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:49.325128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:49.336721 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1217/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:49.619763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b58f3-189a-4461-8304-71e139641971 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:49.621320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f32b58f3-189a-4461-8304-71e139641971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:49.635702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b58f3-189a-4461-8304-71e139641971 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:49.641199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:49.641920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:49.642219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:49.642580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] PATH_INFO: `/v3/projects/262d69dfeffa4f08a64e3eaf60369fd0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:49.644205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262d69dfeffa4f08a64e3eaf60369fd0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:49.646288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:49.696874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262d69dfeffa4f08a64e3eaf60369fd0', 'request_id': 'req-146345c6-f86d-4d6f-8c23-12433a01c785'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.703983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262d69dfeffa4f08a64e3eaf60369fd0', 'request_id': 'req-146345c6-f86d-4d6f-8c23-12433a01c785'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.714160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262d69dfeffa4f08a64e3eaf60369fd0', 'request_id': 'req-146345c6-f86d-4d6f-8c23-12433a01c785'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.729407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] The token cache is being invalidate because project 262d69dfeffa4f08a64e3eaf60369fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:49.729407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.729407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.729407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1205/2422] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:49 2022] DELETE /identity/v3/projects/262d69dfeffa4f08a64e3eaf60369fd0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:49.733463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:49.745377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5893022-2756-4728-99a2-a601558d0ec6 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:49.805338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:49.806600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:49.807030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:49.807376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] PATH_INFO: `/v3/users/b8de83b355554492a3a2bf3a004e3252` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:49.809258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8de83b355554492a3a2bf3a004e3252)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:49.812177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:49.862942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8de83b355554492a3a2bf3a004e3252'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.863589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8de83b355554492a3a2bf3a004e3252'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.864204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8de83b355554492a3a2bf3a004e3252'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.871075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8de83b355554492a3a2bf3a004e3252'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.883555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f682ca49-f2ac-4c2b-bbee-82362f2cc587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8de83b355554492a3a2bf3a004e3252'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:49.897192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1218/2423] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:49 2022] DELETE /identity/v3/users/b8de83b355554492a3a2bf3a004e3252 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:50.179592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.181061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:50.264663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146345c6-f86d-4d6f-8c23-12433a01c785 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.298695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:50.326292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.326925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.327226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.327496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] PATH_INFO: `/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.328793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d6e708bb664bd0aaad97712bd3d9a2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.330857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.380204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d6e708bb664bd0aaad97712bd3d9a2', 'request_id': 'req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:50.386123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d6e708bb664bd0aaad97712bd3d9a2', 'request_id': 'req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:50.394294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d6e708bb664bd0aaad97712bd3d9a2', 'request_id': 'req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:50.404419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] The token cache is being invalidate because project 73d6e708bb664bd0aaad97712bd3d9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:50.404705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:50.405338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ed2e42d8-6382-42b0-b4fe-f7baef84af8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:50.406810 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1206/2424] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:50 2022] DELETE /identity/v3/projects/73d6e708bb664bd0aaad97712bd3d9a2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:50.411990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.412487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.412586 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.485772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:50.487001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:50.528658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:50.551170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1219/2425] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:50.560472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.560758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.561061 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.582096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:50.583315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:50.592012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1207/2426] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:50.596569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.607551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e61b23-0799-4e4c-877c-867c54613667 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.612771 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.613384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.613658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.613928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.614578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:29:50.614882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.616534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.629340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1220/2427] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:29:50.634592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.648059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9996e-8165-401d-9b3b-7ad5ff6c2a31 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.656913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.658001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.658481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.658924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.659864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.662487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.696543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1208/2428] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:50 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:50.701597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.713198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1130e0-5336-4b00-a556-87b150a7cd2e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.796044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.796668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.796946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.797218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.797970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.799901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.823951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1221/2429] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:50 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:50.829707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.840287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6468b9b-868c-4b72-b217-cd4e131d60c8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.845222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.845654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.845933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.846205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.846891 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.848625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.861819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1209/2430] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:50.867468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.880822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb977a86-9bd7-49db-829f-724c1f55c62e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.886029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.886631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.886908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.887180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.887828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.889566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581d4e4-ac73-4e44-91ca-a37b58108967 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.904833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1222/2431] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:50.910939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:50.924603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c52f0-5b17-40e9-9d09-e958a211444c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:50.932530 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:50.933548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.933979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.934250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] PATH_INFO: `/v3/projects/b97468ec2817456585f432712720335e/users/e8c152225e704f8a9dd990cf370d5a84/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:50.956402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97468ec2817456585f432712720335e, user_id=e8c152225e704f8a9dd990cf370d5a84, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:50.959123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:50.976355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1210/2432] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:50 2022] PUT /identity/v3/projects/b97468ec2817456585f432712720335e/users/e8c152225e704f8a9dd990cf370d5a84/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:50.988673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:50.988955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:50.989239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.026294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] MFA Rules not processed for user `e8c152225e704f8a9dd990cf370d5a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:51.028297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:51.119851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1223/2433] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:51.126357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.207198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d0d4b-1bb7-46dd-bd6b-731ef93789eb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.216776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.218172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.218172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.218172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.218580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.221201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.234816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:51.262417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1211/2434] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:51.267630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.279908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df5d40-2021-4c9d-832e-1ba0566726fa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.328068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:51.351564 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.352645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.352919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.353188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.354125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.356101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.391615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1224/2435] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:29:51 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:29:51.396004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.410432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e28fd-d761-45d8-b4ab-209b124896de admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.418251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.418941 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.419387 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.419849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.420970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.423078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.440274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1212/2436] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:51.446844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.463243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed5a00-42ae-4b85-b29a-e2841cf75532 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.469990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.471139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.471577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.472125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] PATH_INFO: `/v3/projects/64b2a54ea45b4e1fb2d70eda46243204/users/216a477228d240c299aceaa98210061e/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.494160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b2a54ea45b4e1fb2d70eda46243204, user_id=216a477228d240c299aceaa98210061e, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.497841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.517720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1225/2437] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:51 2022] PUT /identity/v3/projects/64b2a54ea45b4e1fb2d70eda46243204/users/216a477228d240c299aceaa98210061e/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:51.520221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.531118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b525dfc-67f3-4307-9f28-cfd7e25a0531 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.609325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.610154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.610503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.610775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.611706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.615607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a661-7f07-4152-af24-82286156b4e8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.634074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1213/2438] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:29:51.640899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.652675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ee767-812f-49ff-b13e-b39084ffbf6b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.661307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.662289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.662695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.663317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] PATH_INFO: `/v3/projects/64b2a54ea45b4e1fb2d70eda46243204/users/216a477228d240c299aceaa98210061e/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.667372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b2a54ea45b4e1fb2d70eda46243204, user_id=216a477228d240c299aceaa98210061e, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:51.671249 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:51.686414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1226/2439] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:29:51 2022] PUT /identity/v3/projects/64b2a54ea45b4e1fb2d70eda46243204/users/216a477228d240c299aceaa98210061e/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:29:51.698938 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285d69-a563-48d4-940c-16c976648340 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.699497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285d69-a563-48d4-940c-16c976648340 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.699497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285d69-a563-48d4-940c-16c976648340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:51.736850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d2285d69-a563-48d4-940c-16c976648340 None None] MFA Rules not processed for user `216a477228d240c299aceaa98210061e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:51.738088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2285d69-a563-48d4-940c-16c976648340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:51.836502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1214/2440] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:29:51.849836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:51.851840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:51.940295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ae01f-4261-4c8c-8614-c8db41274662 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:51.944457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:51.945063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:51.945337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:51.945636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:52.008076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:52.019809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab556ff-f7f3-4013-a5da-14089fe027fb service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:52.029799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1227/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:54.643856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285d69-a563-48d4-940c-16c976648340 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:54.710946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285d69-a563-48d4-940c-16c976648340 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:54.716146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:54.716780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:54.717056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:54.717324 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] PATH_INFO: `/v3/users/e8c152225e704f8a9dd990cf370d5a84` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:54.718510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c152225e704f8a9dd990cf370d5a84)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:54.720475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:54.721997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:54.773853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c152225e704f8a9dd990cf370d5a84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:54.780799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c152225e704f8a9dd990cf370d5a84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:54.781450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c152225e704f8a9dd990cf370d5a84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:54.789196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c152225e704f8a9dd990cf370d5a84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:54.802025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c152225e704f8a9dd990cf370d5a84'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:54.808462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1215/2442] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:54 2022] DELETE /identity/v3/users/e8c152225e704f8a9dd990cf370d5a84 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:54.813125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:54.813638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:54.813748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:54.833811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:29:54.835059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:54.863572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:54.898608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1228/2443] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:29:54.908873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:54.910441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:54.968401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18201-5c2a-4476-b4dd-b93513b12f67 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:54.972919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:54.973531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:54.973809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:54.974054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:54.984024 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:54.985495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:54.995507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1216/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:29:55.270975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:55.272829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:55.288378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb415-511d-4a45-99fd-7da4caf6e56a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:55.304365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:55.305031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:55.305444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:55.305599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] PATH_INFO: `/v3/projects/b97468ec2817456585f432712720335e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:55.307130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97468ec2817456585f432712720335e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:55.309089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:55.358777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97468ec2817456585f432712720335e', 'request_id': 'req-3cebb572-ddce-4d09-bd10-f91503e22267'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.366823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97468ec2817456585f432712720335e', 'request_id': 'req-3cebb572-ddce-4d09-bd10-f91503e22267'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.373263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97468ec2817456585f432712720335e', 'request_id': 'req-3cebb572-ddce-4d09-bd10-f91503e22267'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.383990 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] The token cache is being invalidate because project b97468ec2817456585f432712720335e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:55.384282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.384935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.386486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1229/2445] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:55 2022] DELETE /identity/v3/projects/b97468ec2817456585f432712720335e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:55.390661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:55.400988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ff95-289d-488d-81c4-dc92b317b4ff service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:55.462289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:55.462942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:55.463217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:55.463489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] PATH_INFO: `/v3/users/216a477228d240c299aceaa98210061e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:55.464647 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=216a477228d240c299aceaa98210061e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:55.466587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:55.495154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:55.524033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '216a477228d240c299aceaa98210061e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.539750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '216a477228d240c299aceaa98210061e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.540448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '216a477228d240c299aceaa98210061e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.548613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '216a477228d240c299aceaa98210061e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.565871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '216a477228d240c299aceaa98210061e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:55.573090 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1217/2446] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:29:55 2022] DELETE /identity/v3/users/216a477228d240c299aceaa98210061e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:29:55.874041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:29:55.875563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:29:55.889352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebb572-ddce-4d09-bd10-f91503e22267 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:29:55.949126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:29:55.949792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:29:55.950072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:29:55.950341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] PATH_INFO: `/v3/projects/64b2a54ea45b4e1fb2d70eda46243204` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:29:55.951488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b2a54ea45b4e1fb2d70eda46243204)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:29:55.953947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:29:56.003201 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b2a54ea45b4e1fb2d70eda46243204', 'request_id': 'req-9c14ea8e-94a5-45f9-95a9-535058889b73'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:56.010526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b2a54ea45b4e1fb2d70eda46243204', 'request_id': 'req-9c14ea8e-94a5-45f9-95a9-535058889b73'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:56.011659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:29:56.018654 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b2a54ea45b4e1fb2d70eda46243204', 'request_id': 'req-9c14ea8e-94a5-45f9-95a9-535058889b73'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:56.029503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] The token cache is being invalidate because project 64b2a54ea45b4e1fb2d70eda46243204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:29:56.029792 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:56.030435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:29:56.031961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1230/2447] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:29:55 2022] DELETE /identity/v3/projects/64b2a54ea45b4e1fb2d70eda46243204 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:05.569516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:06.026494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=5,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:11.133658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:11.135122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:11.230652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b7f32-6e9a-4b18-a78a-a3f4c030a9ce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:11.291948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:11.292516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:11.292827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:11.293168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:11.295195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:11.308168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:11.310009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:11.321037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1218/2448] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:16.979653 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:16.981360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:17.084760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ea8e-94a5-45f9-95a9-535058889b73 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:17.089487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:17.090094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:17.090366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:17.090634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:17.092519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:17.171421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:17.172885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:17.185588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1231/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:20.299378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:20.301143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:20.316927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db11ada-ce69-4f38-9a65-c95ad57f8f0f service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:20.323485 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:20.324252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:20.324627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:20.325792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:20.333001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:20.346690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:20.348499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:20.360463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1219/2450] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:20.396325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:20.398056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:20.412625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aaa71-b5fa-4800-a863-06d895f6eec2 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:20.418437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:20.419507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:20.420094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:20.420567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] PATH_INFO: `/v3/users/9c06d5a51e984f36879bbb86b6d60513` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:20.422712 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c06d5a51e984f36879bbb86b6d60513)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:20.425024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:20.483878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c06d5a51e984f36879bbb86b6d60513'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.484693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c06d5a51e984f36879bbb86b6d60513'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.485679 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c06d5a51e984f36879bbb86b6d60513'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.494313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c06d5a51e984f36879bbb86b6d60513'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.507837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8fb9830c-ccb8-4c29-9ef7-43b974e87d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c06d5a51e984f36879bbb86b6d60513'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.521342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1232/2451] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:20 2022] DELETE /identity/v3/users/9c06d5a51e984f36879bbb86b6d60513 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:20.706957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:20.718433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d86d8-f4dc-496b-a606-6384e24b02b9 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:20.801125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:20.802097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:20.802373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:20.802639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] PATH_INFO: `/v3/projects/6260890a43ff486598915092afc85446` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:20.803767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6260890a43ff486598915092afc85446)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:20.805712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:20.807488 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:20.861177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6260890a43ff486598915092afc85446', 'request_id': 'req-07ccb3b1-a657-40eb-af60-879aab3c98ef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.870039 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6260890a43ff486598915092afc85446', 'request_id': 'req-07ccb3b1-a657-40eb-af60-879aab3c98ef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.878988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6260890a43ff486598915092afc85446', 'request_id': 'req-07ccb3b1-a657-40eb-af60-879aab3c98ef'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.892290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] The token cache is being invalidate because project 6260890a43ff486598915092afc85446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:20.892767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.893542 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-07ccb3b1-a657-40eb-af60-879aab3c98ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:20.896548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1220/2452] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:20 2022] DELETE /identity/v3/projects/6260890a43ff486598915092afc85446 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:20.902715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:20.903197 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:20.903469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:20.911167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:20.927000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:20.928390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:20.997457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1233/2453] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:21.006907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.007265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.007611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.028184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:21.029503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:21.038252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1221/2454] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:21.044491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.055068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c60a3-6f56-4df3-8173-4e808865edb1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.059936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.060562 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.060839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.061109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.061766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:21.062069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.063655 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.076226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1234/2455] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:30:21.080672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.091031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8752bc4-fe8d-4354-89f0-6471af4c95b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.095863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.096529 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.096804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.097071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.097718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.099622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.129702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1222/2456] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:21 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:21.133974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.145478 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104e559-0482-45b4-91a7-812862b7a95a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.204567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.205846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.205846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.205846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.206435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.208858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.235952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1235/2457] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:21 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:21.237470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.248385 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d441f-a563-47d1-8d3d-54503a0f1244 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.253281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.253887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.254168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.254516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.255305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.257136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.268215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1223/2458] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:30:21.272862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.286780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46d4c9-3aea-4edb-9669-9c7459b09e04 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.295839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.295839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.295839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.295839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.296301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.298333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64659-0cc2-4e2a-8221-ad0de1e118f4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.312001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1236/2459] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:21.316378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.327017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10f493-7865-470b-ab31-ada353b6db26 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.332025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.332677 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.332953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.333227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] PATH_INFO: `/v3/projects/e0c7c1cebcd5419481c2e6240a96b2b2/users/5ebd1476d13a40e6b62f23d0bfcedca6/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.347984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c7c1cebcd5419481c2e6240a96b2b2, user_id=5ebd1476d13a40e6b62f23d0bfcedca6, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.350994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.365441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1224/2460] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:21 2022] PUT /identity/v3/projects/e0c7c1cebcd5419481c2e6240a96b2b2/users/5ebd1476d13a40e6b62f23d0bfcedca6/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:21.376715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.377006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.377286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.406323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] MFA Rules not processed for user `5ebd1476d13a40e6b62f23d0bfcedca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:21.407628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:21.470394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:21.475730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1237/2461] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:21.486534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:21.488351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:21.578190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b561e-7f4c-4f30-8abe-52b8cc788e1b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:21.581983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:21.582595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:21.582931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:21.583201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:21.593054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:21.593921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ae760-ebc2-45fb-8c98-8b15d1888906 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:21.603864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1225/2462] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:30.160296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:30.229505 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4628-a298-48d8-82bc-89dd870a96b5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:30.235035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:30.235669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:30.235953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:30.236245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] PATH_INFO: `/v3/users/5ebd1476d13a40e6b62f23d0bfcedca6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:30.237413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebd1476d13a40e6b62f23d0bfcedca6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:30.239340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:30.288070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebd1476d13a40e6b62f23d0bfcedca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.288810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebd1476d13a40e6b62f23d0bfcedca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.289519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebd1476d13a40e6b62f23d0bfcedca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.296847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebd1476d13a40e6b62f23d0bfcedca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.311080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebd1476d13a40e6b62f23d0bfcedca6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.327810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1238/2463] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:30 2022] DELETE /identity/v3/users/5ebd1476d13a40e6b62f23d0bfcedca6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:30.332411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:30.332906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:30.333010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:30.352492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:30.353643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:30.357746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:30.420859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1226/2464] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:30.431551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:30.433302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:30.494454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2badf2-6f99-4366-803e-dc90637ea5d0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:30.498835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:30.499434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:30.499706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:30.500075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:30.509592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:30.511611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8267e-f21f-4778-b9b7-61d3629723cb service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:30.521110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1239/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:30.821195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:30.822722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:30.842548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e005022-bc17-4c6d-b9bd-111edb0013ab None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:30.855482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:30.856202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:30.856481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:30.856752 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] PATH_INFO: `/v3/projects/e0c7c1cebcd5419481c2e6240a96b2b2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:30.857890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c7c1cebcd5419481c2e6240a96b2b2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:30.860097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:30.914736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c7c1cebcd5419481c2e6240a96b2b2', 'request_id': 'req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.921379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c7c1cebcd5419481c2e6240a96b2b2', 'request_id': 'req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.929888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c7c1cebcd5419481c2e6240a96b2b2', 'request_id': 'req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.941138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] The token cache is being invalidate because project e0c7c1cebcd5419481c2e6240a96b2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:30.941417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.942133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b1f9b04-9a7a-4ab8-a0e2-bea964b9bcd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:30.943799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1227/2466] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:30 2022] DELETE /identity/v3/projects/e0c7c1cebcd5419481c2e6240a96b2b2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:30.948821 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:30.949098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:30.949364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:30.969246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:30.970728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:30.984970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:31.032924 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1240/2467] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:31.040979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.041271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.041771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.064398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:31.065912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:31.076125 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1228/2468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:31.080589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.091122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d07f-051e-43ac-802a-35a1400a3792 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.096332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.096929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.097203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.097470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.098169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:31.098467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.100398 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.112561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1241/2469] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:30:31.117068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.126327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27770ab7-4995-4a2d-9dcd-0f1d65bdec67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.131716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.132361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.132639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.132913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.133544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.135523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.173052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1229/2470] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:31.177577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.188265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baaf06-7db8-4ef5-ad00-5c5965f99c4c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.246785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.247390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.247661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.247949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.248579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.250485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.274772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1242/2471] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:31.279632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.291031 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f6616-8bc3-4bfc-acf1-1734feefa9ed admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.296121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.296720 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.296978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.297245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.298014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.299620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.311153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1230/2472] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:31.315297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.325553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc81d-29a6-4e5f-bb9b-2a1ae65ee509 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.330773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.331369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.331644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.331959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.332602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.334198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493d619-1fe9-4e51-9078-f4410ed39ec0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.347421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1243/2473] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:30:31.354193 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.364979 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffefa10-313e-4a2d-b2c3-2c345fc88b23 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.371446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.372171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.372441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.372711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] PATH_INFO: `/v3/projects/0ee5278542844fa8b36604ce82bde80d/users/206dffda9dc0423d8f4e4ff6df0ca654/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.387853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee5278542844fa8b36604ce82bde80d, user_id=206dffda9dc0423d8f4e4ff6df0ca654, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.390547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.405064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1231/2474] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:31 2022] PUT /identity/v3/projects/0ee5278542844fa8b36604ce82bde80d/users/206dffda9dc0423d8f4e4ff6df0ca654/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:31.415831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.416146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.416448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.443904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] MFA Rules not processed for user `206dffda9dc0423d8f4e4ff6df0ca654`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:31.445084 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:31.520489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1244/2475] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:31.526928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.559372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:31.591487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df584f4-c358-4d20-bf6f-ef99d348947e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.596894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.597497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.597771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.598040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.598666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.600967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.629049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1232/2476] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:31.633266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.644243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac40a-a616-462f-a463-d2e1ed86e39e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.657006 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:31.706934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.707458 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.707732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.708031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.708670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.710600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.734870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1245/2477] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:31.739217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.750596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66efc84-36d1-433d-ac8f-f3a345476b54 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.756360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.756970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.757244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.757536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.758184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.759876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.771066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1233/2478] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:31.775597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.785913 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dac1b-696a-449f-85df-4bafc7ff3d11 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.790662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.791310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.791651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.792019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] PATH_INFO: `/v3/projects/2baa60257702415a8f88d890848c5062/users/566a8974a483497ba02c15aa4aa31098/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.808519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baa60257702415a8f88d890848c5062, user_id=566a8974a483497ba02c15aa4aa31098, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.811374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.826093 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1246/2479] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:31 2022] PUT /identity/v3/projects/2baa60257702415a8f88d890848c5062/users/566a8974a483497ba02c15aa4aa31098/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:31.830464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.840952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aed5d-b2f1-4d68-9478-523caa772492 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.904216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.904817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.905093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.905358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.905988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.907586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057935-549e-4531-8499-be2c844841eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.917969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1234/2480] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:31.922281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:31.933087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2672bd-b441-42ec-b96a-aecae491cb4b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:31.937936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:31.938575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.938836 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.939103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] PATH_INFO: `/v3/projects/2baa60257702415a8f88d890848c5062/users/566a8974a483497ba02c15aa4aa31098/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.941109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baa60257702415a8f88d890848c5062, user_id=566a8974a483497ba02c15aa4aa31098, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:31.943738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:31.954276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1247/2481] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:31 2022] PUT /identity/v3/projects/2baa60257702415a8f88d890848c5062/users/566a8974a483497ba02c15aa4aa31098/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:31.966290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:31.966511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:31.966773 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:31.995048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] MFA Rules not processed for user `566a8974a483497ba02c15aa4aa31098`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:31.996560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:32.069225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1235/2482] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:32.081383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:32.083152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:32.144396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26bff-9a70-456e-9cd7-c79871b538dc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:32.148180 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:32.148900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:32.149234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:32.149558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:32.159285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:32.160730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:32.170273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1248/2483] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:32.248200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:32.257838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61532ae-a0c0-40e1-8bc0-2b3aafebad83 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:32.261566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:32.262161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:32.262454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:32.262702 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:32.282968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:32.324119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:32.325596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:32.334846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1236/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:34.616548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:34.618179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:34.677767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4077527-d8bb-428a-9a84-7f90578a9a14 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:34.681793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:34.682406 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:34.682709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:34.682976 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:34.684912 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:34.712212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:34.758491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:34.760012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb3d93-e53e-45d5-bee4-cb216934b4d2 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:34.769210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1249/2485] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:39.335248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:39.444412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420d43-437f-40a2-9ea1-71b5b864fc25 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:39.456558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:39.456919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:39.457195 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:39.457793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] PATH_INFO: `/v3/users/206dffda9dc0423d8f4e4ff6df0ca654` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:39.458811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=206dffda9dc0423d8f4e4ff6df0ca654)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:39.461776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:39.547346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206dffda9dc0423d8f4e4ff6df0ca654'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:39.576489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206dffda9dc0423d8f4e4ff6df0ca654'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:39.578506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206dffda9dc0423d8f4e4ff6df0ca654'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:39.590280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206dffda9dc0423d8f4e4ff6df0ca654'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:39.607323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206dffda9dc0423d8f4e4ff6df0ca654'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:39.621188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1237/2486] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:39 2022] DELETE /identity/v3/users/206dffda9dc0423d8f4e4ff6df0ca654 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:39.623637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:39.624738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:39.624738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:39.652402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:39.653794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:39.719199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1250/2487] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:39.730216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:39.731700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:39.794020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:39.809928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64084e-5daf-4c5a-ac0b-4d9fde021618 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:39.814501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:39.815119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:39.815426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:39.815942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:39.827875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:39.829612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:39.845625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1238/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:40.156893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:40.158939 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:40.173950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06259a6-5a45-4a04-a0bf-f8b50e51a21d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:40.179708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:40.180493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:40.180839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:40.181167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] PATH_INFO: `/v3/projects/0ee5278542844fa8b36604ce82bde80d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:40.183178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee5278542844fa8b36604ce82bde80d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:40.185802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:40.238369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee5278542844fa8b36604ce82bde80d', 'request_id': 'req-ce194691-4632-40d3-bc89-92133c2177a7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.247042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee5278542844fa8b36604ce82bde80d', 'request_id': 'req-ce194691-4632-40d3-bc89-92133c2177a7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.253965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee5278542844fa8b36604ce82bde80d', 'request_id': 'req-ce194691-4632-40d3-bc89-92133c2177a7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.265237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] The token cache is being invalidate because project 0ee5278542844fa8b36604ce82bde80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:40.265497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.266188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.267713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1251/2489] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:40 2022] DELETE /identity/v3/projects/0ee5278542844fa8b36604ce82bde80d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:40.271837 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:40.283969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeffd9-3533-4201-ae61-a2d143c2d520 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:40.346303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:40.347042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:40.347257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:40.347478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] PATH_INFO: `/v3/users/566a8974a483497ba02c15aa4aa31098` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:40.348759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] RBAC: Authorizing `identity:delete_user(user_id=566a8974a483497ba02c15aa4aa31098)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:40.351065 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:40.409143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566a8974a483497ba02c15aa4aa31098'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.417675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566a8974a483497ba02c15aa4aa31098'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.419083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566a8974a483497ba02c15aa4aa31098'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.427352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566a8974a483497ba02c15aa4aa31098'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.440029 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566a8974a483497ba02c15aa4aa31098'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:40.446271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1239/2490] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:40 2022] DELETE /identity/v3/users/566a8974a483497ba02c15aa4aa31098 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:40.807461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:40.812240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:40.861918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194691-4632-40d3-bc89-92133c2177a7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.006342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:41.037615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.043293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.091622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.093217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.093588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.093923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] PATH_INFO: `/v3/projects/2baa60257702415a8f88d890848c5062` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.095470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2baa60257702415a8f88d890848c5062)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.102871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.156988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08765f1-4d41-42ab-801b-3ceb686a466d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.162599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.164832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.164832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.164832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.166454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.177371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2baa60257702415a8f88d890848c5062', 'request_id': 'req-a214892d-3dcd-4ec4-8f59-f77a312e7111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:41.184070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.186497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a12a15-75aa-4d2f-8e88-ddcfe08c99c3 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.188616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2baa60257702415a8f88d890848c5062', 'request_id': 'req-a214892d-3dcd-4ec4-8f59-f77a312e7111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:41.199020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2baa60257702415a8f88d890848c5062', 'request_id': 'req-a214892d-3dcd-4ec4-8f59-f77a312e7111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:41.199609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1240/2491] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:41.211285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] The token cache is being invalidate because project 2baa60257702415a8f88d890848c5062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:41.211567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:41.212328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a214892d-3dcd-4ec4-8f59-f77a312e7111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:41.214604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1252/2492] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:40 2022] DELETE /identity/v3/projects/2baa60257702415a8f88d890848c5062 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:41.219477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.220015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.220119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.236081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:41.246785 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:41.249146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.325048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1241/2493] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:41.333576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.333855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.334212 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.359870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:41.361287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.371000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1253/2494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:41.375307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.389194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5a5a-fb9d-4b13-9f6a-2dd5b112d656 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.394482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.395163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.395443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.395715 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.396443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:41.396761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.399644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.417192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1242/2495] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:30:41.418019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.430695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b610c-36ff-4177-8a90-1ee41f3f01f1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.444020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.444824 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.445192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.445553 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.446288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.449491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.481547 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1254/2496] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:41.485426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.502277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe3f0e-0854-4f07-babd-d80dfa823a8b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.580902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.582329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.582706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.583100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.583776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.586101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.623965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1243/2497] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:41.626243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.639127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b12dd-5e55-4791-acda-c4fc3420e759 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.645199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.645199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.645666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.647002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.647766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.649596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.664003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1255/2498] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:41.668207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.683908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff490-e5e8-4f44-af47-1f063928f9fe admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.690005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.691729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.692088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.692356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.693003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.695552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fdecb-1ad4-4c80-b726-5f2ba1ab9b54 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.710813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1244/2499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:41.715659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.735893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63ba94-652e-4af6-8231-8c55c1e64477 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:41.742906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:41.745895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.745895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.745895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] PATH_INFO: `/v3/projects/4fc11be772244f53aface3a3851c12ac/users/f0cced4b3fc646108ba01c6267df6d8f/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.769440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc11be772244f53aface3a3851c12ac, user_id=f0cced4b3fc646108ba01c6267df6d8f, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:41.776125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a81b3-d594-4bfc-ade6-0bd8296cb78a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:41.783480 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.783784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.784181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.810231 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1256/2500] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:41 2022] PUT /identity/v3/projects/4fc11be772244f53aface3a3851c12ac/users/f0cced4b3fc646108ba01c6267df6d8f/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:41.819263 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:41.820823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.822087 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:41.822372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:41.822986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:41.865873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] MFA Rules not processed for user `f0cced4b3fc646108ba01c6267df6d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:41.867027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:41.919858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1245/2501] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:30:41.965263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1257/2502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:41.972931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.980868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:41.997500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:41.999413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:42.007171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:42.084899 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548590-833d-477f-a67e-ceb5a15a18ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:42.092437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:42.093069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:42.093368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:42.093652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:42.094521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:42.096638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:42.139510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497fc12-cbe1-4597-a292-95aecd02fee2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:42.145331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1246/2503] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:41 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:42.150883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:42.152005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:42.152430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:42.153139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:42.157182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:42.163797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:42.165680 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:42.185286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1258/2504] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:30:42.334553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061f648-03b5-4e27-bf3d-76d11fed20a0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:42.354560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:42.355653 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:42.355963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:42.356303 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:42.356975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:42.363548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:42.428053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1247/2505] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:42 2022] POST /identity/v3/users => generated 291 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:42.430325 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:42.448218 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2641f2-c6f9-49a3-995c-cf7c5e4dc0e2 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:42.464291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:42.465187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:42.465467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:42.465732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:42.466382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:42.471588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:42.516963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:42.522029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1259/2506] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:42.532957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086078d0-1f86-4ab9-8be7-6c8b53b2cfd4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:42.552444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:42.553396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:42.553520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:42.557226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] PATH_INFO: `/v3/projects/6695417a13f54221acefa3c4501f4c21/users/53224a9de05444bbaa391effe960016a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:42.794932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6695417a13f54221acefa3c4501f4c21, user_id=53224a9de05444bbaa391effe960016a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:42.799138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:42.851791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:42.852475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1248/2507] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:42 2022] PUT /identity/v3/projects/6695417a13f54221acefa3c4501f4c21/users/53224a9de05444bbaa391effe960016a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:42.871387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66133-7078-41a5-abfb-63b2fab5b882 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:43.000043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:43.000720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:43.001002 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:43.001288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:43.002204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:43.003962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5a4c4-dc33-4537-842b-d68570bc7c86 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:43.016781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1260/2508] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:43.021685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:43.039770 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acdfca-209e-4b36-8601-2a53fc9d495e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:43.050614 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:43.053417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:43.053417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:43.054445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] PATH_INFO: `/v3/projects/6695417a13f54221acefa3c4501f4c21/users/53224a9de05444bbaa391effe960016a/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:43.057878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6695417a13f54221acefa3c4501f4c21, user_id=53224a9de05444bbaa391effe960016a, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:43.060559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:43.089650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1249/2509] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:43 2022] PUT /identity/v3/projects/6695417a13f54221acefa3c4501f4c21/users/53224a9de05444bbaa391effe960016a/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:43.094705 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:43.094991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:43.095262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:43.154042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] MFA Rules not processed for user `53224a9de05444bbaa391effe960016a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:43.156223 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:43.270412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1261/2510] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:43.282165 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:43.283851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:43.437508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:43.471719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db9dba-384f-4f8f-aba0-e105b7242dff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:43.477114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:43.478410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:43.478803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:43.479171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:43.500621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:43.502768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:43.522722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1250/2511] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:43.607209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:43.609486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:43.658320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:43.670242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc2bfb-88d0-4a45-ad91-a413a50b8787 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:43.703860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:43.709818 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:43.710122 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:43.710545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:43.865465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:43.868119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785c6b8-214c-46b4-af4d-4d6ec18a543e service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:43.891190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1262/2512] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:48.806828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:48.943850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ae94-0853-4e9a-aadc-816c33885e10 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:48.955522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:48.956260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:48.956535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:48.956807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] PATH_INFO: `/v3/users/f0cced4b3fc646108ba01c6267df6d8f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:48.958036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cced4b3fc646108ba01c6267df6d8f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:48.960338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:49.020253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cced4b3fc646108ba01c6267df6d8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:49.032247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cced4b3fc646108ba01c6267df6d8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:49.033238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cced4b3fc646108ba01c6267df6d8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:49.042556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cced4b3fc646108ba01c6267df6d8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:49.059180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cced4b3fc646108ba01c6267df6d8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:49.066222 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1251/2513] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:48 2022] DELETE /identity/v3/users/f0cced4b3fc646108ba01c6267df6d8f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:49.070804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:49.071888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:49.072412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:49.094932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:49.097706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:49.199046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1263/2514] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:30:49.209920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:49.211506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:49.295290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb32f73-97d4-416f-96b2-30b478b69b57 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:49.306736 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:49.307792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:49.308747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:49.309255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:49.330336 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:49.331888 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:49.343862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1252/2515] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:49.945542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:49.948588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:49.997714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dc4fe-4acd-4da5-b20a-3086bde0d7c4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:50.012064 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:50.013592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:50.013884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:50.014162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] PATH_INFO: `/v3/projects/4fc11be772244f53aface3a3851c12ac` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:50.018617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc11be772244f53aface3a3851c12ac)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:50.022329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:50.101524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc11be772244f53aface3a3851c12ac', 'request_id': 'req-9a63d6b8-15cf-4142-b62e-41088d3c2873'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.121366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc11be772244f53aface3a3851c12ac', 'request_id': 'req-9a63d6b8-15cf-4142-b62e-41088d3c2873'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.140204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc11be772244f53aface3a3851c12ac', 'request_id': 'req-9a63d6b8-15cf-4142-b62e-41088d3c2873'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.167652 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] The token cache is being invalidate because project 4fc11be772244f53aface3a3851c12ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:50.168058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.168651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.171469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1264/2516] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:49 2022] DELETE /identity/v3/projects/4fc11be772244f53aface3a3851c12ac => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:50.174505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:50.183121 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:50.192107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7bc54-50f2-4a75-8ce0-9ee391254ec0 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:50.341280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:50.342237 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:50.342750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:50.343136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] PATH_INFO: `/v3/users/53224a9de05444bbaa391effe960016a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:50.345239 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53224a9de05444bbaa391effe960016a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:50.349185 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:50.511071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53224a9de05444bbaa391effe960016a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.540182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53224a9de05444bbaa391effe960016a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.541397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53224a9de05444bbaa391effe960016a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.563134 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53224a9de05444bbaa391effe960016a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.595540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01bee37a-9cb8-4845-82fe-30a6c021691b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53224a9de05444bbaa391effe960016a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:50.611100 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1253/2517] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:50 2022] DELETE /identity/v3/users/53224a9de05444bbaa391effe960016a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:51.975696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:51.979219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:52.016857 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d6b8-15cf-4142-b62e-41088d3c2873 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:52.090741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:52.222447 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:52.223130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:52.223401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:52.224051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] PATH_INFO: `/v3/projects/6695417a13f54221acefa3c4501f4c21` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:52.225268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6695417a13f54221acefa3c4501f4c21)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:52.227288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:52.378305 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6695417a13f54221acefa3c4501f4c21', 'request_id': 'req-deb28107-b14a-4919-bd80-0788ba20b626'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:52.408035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6695417a13f54221acefa3c4501f4c21', 'request_id': 'req-deb28107-b14a-4919-bd80-0788ba20b626'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:52.443598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6695417a13f54221acefa3c4501f4c21', 'request_id': 'req-deb28107-b14a-4919-bd80-0788ba20b626'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:52.474401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] The token cache is being invalidate because project 6695417a13f54221acefa3c4501f4c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:52.474775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:52.477028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-deb28107-b14a-4919-bd80-0788ba20b626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:52.484575 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:52.485127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:52.485127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:52.488621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1265/2518] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:51 2022] DELETE /identity/v3/projects/6695417a13f54221acefa3c4501f4c21 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:52.526219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:52.531040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:52.684680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1254/2519] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:52.693599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:52.693599 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:52.693923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:52.765697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:52.767929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:52.812282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1266/2520] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:52.815725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:52.834735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c9630-f64b-4fdc-99a6-0912b8d9b30a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:52.850010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:52.850695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:52.851960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:52.852232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:52.854490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:52.858493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:52.866446 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:52.897268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1255/2521] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:30:52.899440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:52.926095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50103-7194-4418-8af3-039476be3ac8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:52.952650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:52.953076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:52.955401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:52.955687 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:52.956617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:52.958550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.048058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1267/2522] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:52 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:53.058460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.074355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee84f-7414-4b99-8941-85bd39626e08 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.095976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:53.233976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.234982 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.235512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.236251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.237175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.239329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.285133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1256/2523] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:53 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:53.286381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.297955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946703fb-75c5-4ee7-8e03-ef8dea346bfc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.320388 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.321066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.321350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.321626 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.322318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.323970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.341799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1268/2524] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:53.345574 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.377697 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebe13e-cf17-48b4-9905-bf15acfca4e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.389931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.392717 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.393045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.393325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.394272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.395874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d6ebc-e693-47cb-9d79-bd936819ff0f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.418922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1257/2525] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:53.419775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.438099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ad30f-e43e-41d4-abb2-be5360190025 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.447298 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.448330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.448805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.449237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] PATH_INFO: `/v3/projects/d752e77f51a7438994603f1abfdc3f2f/users/50c2153ecfec4b92a003dfb90a50fd11/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.497720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d752e77f51a7438994603f1abfdc3f2f, user_id=50c2153ecfec4b92a003dfb90a50fd11, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.501848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.544811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1269/2526] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:53 2022] PUT /identity/v3/projects/d752e77f51a7438994603f1abfdc3f2f/users/50c2153ecfec4b92a003dfb90a50fd11/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:53.565784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.566718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.567204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.614076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] MFA Rules not processed for user `50c2153ecfec4b92a003dfb90a50fd11`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:53.615297 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:53.730355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1258/2527] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:53.735244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.823266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:53.852096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f54ea9-2d0f-47af-aa92-6691a310655a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.858813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:53.860617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:53.869916 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.870556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.870838 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.871114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.871759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.874735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.885547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed07fc9-0919-4c95-992e-61bc9693efe1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:53.893252 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:53.894153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:53.894540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:53.894907 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] PATH_INFO: `/v3/users/842c9ca8f59049bd8dcc4bb0e9b27032` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:53.897246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=842c9ca8f59049bd8dcc4bb0e9b27032)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:53.899381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:53.935848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1270/2528] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:53 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:53.940718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.021213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842c9ca8f59049bd8dcc4bb0e9b27032'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.037429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842c9ca8f59049bd8dcc4bb0e9b27032'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.038704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842c9ca8f59049bd8dcc4bb0e9b27032'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.060531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842c9ca8f59049bd8dcc4bb0e9b27032'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.069728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd2b5-01ef-416b-ae48-e6f738dd4a0f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.076351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:54.082661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.084770 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.085051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.085533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.086268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.089972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.091540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842c9ca8f59049bd8dcc4bb0e9b27032'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.108190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1259/2529] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:53 2022] DELETE /identity/v3/users/842c9ca8f59049bd8dcc4bb0e9b27032 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:54.142745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1271/2530] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:53 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:54.148996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.151774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:54.266384 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab834-37a4-43c5-b8c0-733605002dcf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.278502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.279517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.279830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.280563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.281275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.290937 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.302232 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1260/2531] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:54.306937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.332640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bbbd6-764f-48a3-abcc-e48eed504bf9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.343693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.344804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.345548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.347048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] PATH_INFO: `/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8/users/b32651aff394429db9d3b5981a3faf71/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.367387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=696a83c6b0544fbdb5ca7df12a64cca8, user_id=b32651aff394429db9d3b5981a3faf71, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.371448 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.398290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1272/2532] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:54 2022] PUT /identity/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8/users/b32651aff394429db9d3b5981a3faf71/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:54.402279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.417868 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035ec2-b9f6-4c13-8a70-a9e4b838ae18 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.511224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.511872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.512182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.512562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.513092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.514964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77e628-6803-4453-b15b-d98d388bcbd6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.530987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1261/2533] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:54.540999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.556265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd40e-7c33-4f42-8954-e7681f1ebffe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.564416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.565808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.566473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.567110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] PATH_INFO: `/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8/users/b32651aff394429db9d3b5981a3faf71/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.570056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=696a83c6b0544fbdb5ca7df12a64cca8, user_id=b32651aff394429db9d3b5981a3faf71, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.574901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.599017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1273/2534] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:54 2022] PUT /identity/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8/users/b32651aff394429db9d3b5981a3faf71/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:54.615352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.616123 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.616335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.629138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.636608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:54.688381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] MFA Rules not processed for user `b32651aff394429db9d3b5981a3faf71`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:54.690905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:54.824064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1262/2535] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:54.838136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:54.842251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:54.845888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114bb65-ab4b-4902-bb11-6bf4fd2a5ede admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.855449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:54.856242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:54.856589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:54.856931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] PATH_INFO: `/v3/projects/376496c7944849d09b34aec6c408e735` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:54.858542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376496c7944849d09b34aec6c408e735)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:54.861843 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:54.871377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:54.931833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:54.950369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376496c7944849d09b34aec6c408e735', 'request_id': 'req-50ad3f61-26bd-422a-af8b-31dccd471258'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.965133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376496c7944849d09b34aec6c408e735', 'request_id': 'req-50ad3f61-26bd-422a-af8b-31dccd471258'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:54.968809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7dcd7-89f7-4c51-8bbb-eefa2045dfd5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:54.993893 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376496c7944849d09b34aec6c408e735', 'request_id': 'req-50ad3f61-26bd-422a-af8b-31dccd471258'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.006394 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] The token cache is being invalidate because project 376496c7944849d09b34aec6c408e735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:55.006673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.007830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.009291 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1274/2536] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:54 2022] DELETE /identity/v3/projects/376496c7944849d09b34aec6c408e735 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:55.012994 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:55.015328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.045972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:55.046597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.046942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.047151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.049309 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.101167 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad3f61-26bd-422a-af8b-31dccd471258 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:55.109191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:55.109980 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.110258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.110606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] PATH_INFO: `/v3/users/1752ee71f4c045fea14c395c1dd7d291` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.112023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1752ee71f4c045fea14c395c1dd7d291)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:55.114360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:55.149291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:55.151072 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:55.182007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1263/2537] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:30:55.185451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1752ee71f4c045fea14c395c1dd7d291'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.186384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1752ee71f4c045fea14c395c1dd7d291'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.187174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1752ee71f4c045fea14c395c1dd7d291'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.198536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1752ee71f4c045fea14c395c1dd7d291'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.207316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:55.208917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.230693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaa838-453b-4136-9011-ef1199cc660e service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:55.234229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4f7ee904-21c8-4dd1-a5c5-027291ef69c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1752ee71f4c045fea14c395c1dd7d291'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.239705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:55.240611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.240921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.241128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] PATH_INFO: `/v3/users/50c2153ecfec4b92a003dfb90a50fd11` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.242894 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c2153ecfec4b92a003dfb90a50fd11)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:55.245779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:55.255503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1275/2538] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:55 2022] DELETE /identity/v3/users/1752ee71f4c045fea14c395c1dd7d291 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:55.316885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c2153ecfec4b92a003dfb90a50fd11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.327656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c2153ecfec4b92a003dfb90a50fd11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.328398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c2153ecfec4b92a003dfb90a50fd11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.336625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c2153ecfec4b92a003dfb90a50fd11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.342819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:55.352338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c2153ecfec4b92a003dfb90a50fd11'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.365759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1264/2539] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:55 2022] DELETE /identity/v3/users/50c2153ecfec4b92a003dfb90a50fd11 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:55.368038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.368321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.368591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.390787 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:55.392191 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.445140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:55.494279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:55.496175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.518371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1276/2540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:55.522104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78c1d0-c917-495b-844a-7d4ea1af5a02 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:55.528398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:55.529045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.529316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.529595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] PATH_INFO: `/v3/projects/b11ce34ad846402aaa54574fc96bf334` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.530823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11ce34ad846402aaa54574fc96bf334)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:55.532849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:55.537273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:55.538692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.618476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11ce34ad846402aaa54574fc96bf334', 'request_id': 'req-fd7451d9-66ae-45e8-aaab-8434e16b49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.627224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11ce34ad846402aaa54574fc96bf334', 'request_id': 'req-fd7451d9-66ae-45e8-aaab-8434e16b49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.635369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed37c-2b11-4584-804d-1f66be427537 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:55.639692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11ce34ad846402aaa54574fc96bf334', 'request_id': 'req-fd7451d9-66ae-45e8-aaab-8434e16b49a0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.655007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] The token cache is being invalidate because project b11ce34ad846402aaa54574fc96bf334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:55.655301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.656014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:55.658838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1265/2541] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:55 2022] DELETE /identity/v3/projects/b11ce34ad846402aaa54574fc96bf334 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:55.742544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:55.744185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:55.744697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:55.745345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:55.748055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:55.842215 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:55.844009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:55.860130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1277/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:56.231545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:56.232695 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:56.248806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7451d9-66ae-45e8-aaab-8434e16b49a0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:56.269632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:56.269632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:56.269632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:56.269632 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] PATH_INFO: `/v3/projects/d752e77f51a7438994603f1abfdc3f2f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:56.270187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d752e77f51a7438994603f1abfdc3f2f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:56.270187 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:56.330986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd752e77f51a7438994603f1abfdc3f2f', 'request_id': 'req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.343146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd752e77f51a7438994603f1abfdc3f2f', 'request_id': 'req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.352700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd752e77f51a7438994603f1abfdc3f2f', 'request_id': 'req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.366597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] The token cache is being invalidate because project d752e77f51a7438994603f1abfdc3f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:56.366871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.368648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.370272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1266/2543] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:56 2022] DELETE /identity/v3/projects/d752e77f51a7438994603f1abfdc3f2f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:56.374472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:56.388355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f32eb-a6b2-4d0e-b9b3-710f744f9095 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:56.441047 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:56.455184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:56.455841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:56.456159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:56.456483 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] PATH_INFO: `/v3/users/b32651aff394429db9d3b5981a3faf71` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:56.457759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32651aff394429db9d3b5981a3faf71)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:56.460283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:56.515738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32651aff394429db9d3b5981a3faf71'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.516437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32651aff394429db9d3b5981a3faf71'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.517668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32651aff394429db9d3b5981a3faf71'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.528279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32651aff394429db9d3b5981a3faf71'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.542063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-27abd92f-2f97-4af9-924a-bf7fccd4ddfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32651aff394429db9d3b5981a3faf71'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:56.561234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1278/2544] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:56 2022] DELETE /identity/v3/users/b32651aff394429db9d3b5981a3faf71 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:56.937005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:56.938735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:56.959688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3f8c-adab-4d77-8eb0-6cf605c90313 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.036140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:57.050047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.052661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.053335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.055649 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] PATH_INFO: `/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.056735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] RBAC: Authorizing `identity:delete_project(project_id=696a83c6b0544fbdb5ca7df12a64cca8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.058823 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.110036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696a83c6b0544fbdb5ca7df12a64cca8', 'request_id': 'req-8533d521-e52d-4d19-b0f9-f506f453258b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:57.117221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696a83c6b0544fbdb5ca7df12a64cca8', 'request_id': 'req-8533d521-e52d-4d19-b0f9-f506f453258b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:57.127269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696a83c6b0544fbdb5ca7df12a64cca8', 'request_id': 'req-8533d521-e52d-4d19-b0f9-f506f453258b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:57.138934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] The token cache is being invalidate because project 696a83c6b0544fbdb5ca7df12a64cca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:57.139515 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:57.140228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8533d521-e52d-4d19-b0f9-f506f453258b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:57.145377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1267/2545] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:56 2022] DELETE /identity/v3/projects/696a83c6b0544fbdb5ca7df12a64cca8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:57.146926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.147292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.147611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.169414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:57.171741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:57.244274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1279/2546] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:30:57.251140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.251423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.251698 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.271626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:57.273170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:57.281517 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1268/2547] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:57.285833 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.306476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3638dd-64b8-4807-ad58-fda37a5d7584 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.320849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.321530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.321812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.322089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.322759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:57.323061 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.324727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.353444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1280/2548] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:30:57.354443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.364586 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d5f9-8d91-48da-a163-1f3dafe50a08 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.381644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.382430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.382980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.382980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.383892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.386092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.434565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1269/2549] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:57.438929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.471751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8486d-f10d-4395-aab2-3a1cf6a7353d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.544552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:57.555974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.556573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.556844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.557110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.557744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.559666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.590349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1281/2550] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:57.594246 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.609784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098df640-29c0-4cb4-a72f-ad6686fd93e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.614686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.615294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.615593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.615860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.616547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.618545 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.633050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1270/2551] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:30:57.634944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.651060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cb0f5-f228-4847-9fb3-f7e2dfe56b17 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.656590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.657449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.657879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.658322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.659220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.661512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c2d72-f365-46a2-8075-03ee55eec63f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.678341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1282/2552] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:30:57.683007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.693718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402857e-41ec-42c6-a43e-4e74977eff5d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.699025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.699798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.700145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.700426 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] PATH_INFO: `/v3/projects/1cf7562fc9ab4c52881a57f373ed7a8f/users/30feeee790384d9f8b6e45f22180ddf3/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.717923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf7562fc9ab4c52881a57f373ed7a8f, user_id=30feeee790384d9f8b6e45f22180ddf3, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.720753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:57.741538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1271/2553] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:57 2022] PUT /identity/v3/projects/1cf7562fc9ab4c52881a57f373ed7a8f/users/30feeee790384d9f8b6e45f22180ddf3/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:57.752692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179904-e472-4a8c-8223-052db193b905 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.753113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179904-e472-4a8c-8223-052db193b905 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.753504 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179904-e472-4a8c-8223-052db193b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.792643 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b7179904-e472-4a8c-8223-052db193b905 None None] MFA Rules not processed for user `30feeee790384d9f8b6e45f22180ddf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:57.794138 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b7179904-e472-4a8c-8223-052db193b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:57.878321 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1283/2554] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:57.882800 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:57.956778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a94f4-ee7a-4a8c-87e8-cd37589d9ef5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:57.962873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:57.963491 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:57.963763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:57.964068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:57.964705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:57.966608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.000214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1272/2555] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:57 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:58.004170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179904-e472-4a8c-8223-052db193b905 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.015834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179904-e472-4a8c-8223-052db193b905 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.085540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.086189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.086545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.086767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.087450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.089416 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.118952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1284/2556] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:30:58 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:30:58.125215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.136789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:58.141561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368544-9366-4caa-82e8-fa1955091582 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.151087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.152010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.152466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.153107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.153902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.156337 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.174261 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1273/2557] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:30:58.175882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.186423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71393c-8af9-4da6-935c-b2c2024b54d9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.193116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.193784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.194058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.194331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] PATH_INFO: `/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1/users/c53d4e72338d4a89872d2157c607e2ad/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.211666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd3e1ce04704b4fa14e868adbe28fd1, user_id=c53d4e72338d4a89872d2157c607e2ad, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.214743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.235863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.236677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1285/2558] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:58 2022] PUT /identity/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1/users/c53d4e72338d4a89872d2157c607e2ad/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:58.251110 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0626324-509e-483a-9585-f2b11f7f1636 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.314944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.315604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.315949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.316258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.316897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.318533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d06e45-ff54-4d6a-96ac-e7cc5887e3da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.329495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1274/2559] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:30:58.333773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.348108 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9fd14-48c1-4266-b658-dde8db213b89 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.353966 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.354623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.354897 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.355164 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] PATH_INFO: `/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1/users/c53d4e72338d4a89872d2157c607e2ad/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.357136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd3e1ce04704b4fa14e868adbe28fd1, user_id=c53d4e72338d4a89872d2157c607e2ad, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.359871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.373094 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1286/2560] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:30:58 2022] PUT /identity/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1/users/c53d4e72338d4a89872d2157c607e2ad/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:58.383992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.383992 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.384265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.413796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] MFA Rules not processed for user `c53d4e72338d4a89872d2157c607e2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:58.415272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:58.489470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1275/2561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:58.503526 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.505371 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:58.520999 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:58.571548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a9bb-7ecf-4745-835c-7cd488a6470b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.575369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.576021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.576304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.576576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.585500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.587028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.596629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1287/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:58.783219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.784850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:58.853975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb250d-074e-4228-bf71-c1b4366eef86 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.857838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.858714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.859041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.859360 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.861893 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:58.894840 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:58.942638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.944182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:58.955724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1276/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:30:58.969971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:58.980387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e5fc-05e4-4633-abe7-444885441a65 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:58.985575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53d4e72338d4a89872d2157c607e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd3e1ce04704b4fa14e868adbe28fd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:58.986184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:58.986461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:58.986733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:58.987385 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:58.987688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:58.989367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:59.003969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1288/2564] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:30:59.008404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:59.019745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9caa0e-1822-47d5-8a7b-a931ed97b027 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:59.024610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53d4e72338d4a89872d2157c607e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd3e1ce04704b4fa14e868adbe28fd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:59.025202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:59.025513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:59.025851 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:59.026496 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:59.028594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:59.057704 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1277/2565] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:30:59 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:30:59.062254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:59.072848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3336-483d-4f3f-b0a2-e12d34f30fbf tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:59.129733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53d4e72338d4a89872d2157c607e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd3e1ce04704b4fa14e868adbe28fd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:59.130477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:59.130763 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:59.131035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:59.131685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:30:59.132025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:59.133739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:59.145900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1289/2566] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:30:59.203268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:59.218161 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04bc0-cce0-4469-9dc8-f3b69c8a0629 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:59.224872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c53d4e72338d4a89872d2157c607e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bd3e1ce04704b4fa14e868adbe28fd1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:59.225550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:59.225831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:59.226106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] PATH_INFO: `/v3/projects/90fc27633b594e4e8456ab9fafda64c1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:59.227399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorizing `identity:delete_project(project_id=90fc27633b594e4e8456ab9fafda64c1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:59.229373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:59.301564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fc27633b594e4e8456ab9fafda64c1', 'request_id': 'req-78b107ed-ff11-4c22-9b99-5e6f6a707e19'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.309927 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fc27633b594e4e8456ab9fafda64c1', 'request_id': 'req-78b107ed-ff11-4c22-9b99-5e6f6a707e19'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.319581 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fc27633b594e4e8456ab9fafda64c1', 'request_id': 'req-78b107ed-ff11-4c22-9b99-5e6f6a707e19'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.332606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] The token cache is being invalidate because project 90fc27633b594e4e8456ab9fafda64c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:30:59.333028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.333811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-78b107ed-ff11-4c22-9b99-5e6f6a707e19 tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.335603 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1278/2567] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:30:59 2022] DELETE /identity/v3/projects/90fc27633b594e4e8456ab9fafda64c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:30:59.580619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:59.582429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:59.651020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5b076-416e-4953-9740-3dcfd3fb873f tempest-VolumeQuotaClassesTest-2047442462 tempest-VolumeQuotaClassesTest-2047442462-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:30:59.695402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:30:59.712455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:30:59.713059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:59.713338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:59.713610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] PATH_INFO: `/v3/users/30feeee790384d9f8b6e45f22180ddf3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:59.714864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30feeee790384d9f8b6e45f22180ddf3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:30:59.716846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:30:59.772238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30feeee790384d9f8b6e45f22180ddf3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.772890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30feeee790384d9f8b6e45f22180ddf3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.773538 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30feeee790384d9f8b6e45f22180ddf3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.781424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30feeee790384d9f8b6e45f22180ddf3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.795945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30feeee790384d9f8b6e45f22180ddf3'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:30:59.817409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1290/2568] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:30:59 2022] DELETE /identity/v3/users/30feeee790384d9f8b6e45f22180ddf3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:30:59.818856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:30:59.819150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:30:59.819430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:30:59.850312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:30:59.852194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:30:59.948760 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1279/2569] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:30:59.961915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:30:59.964174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:00.049142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5518e7c-1b4d-4f34-a070-bc57d7dee351 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:00.053048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:00.053738 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:00.054076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:00.054431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:00.065598 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:00.067352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:00.078992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1291/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:00.999183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:01.000803 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:01.013663 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc957523-80a4-4757-b042-174b7a7ee2e9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:01.018757 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:01.019497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:01.019841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:01.020214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] PATH_INFO: `/v3/projects/1cf7562fc9ab4c52881a57f373ed7a8f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:01.021435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf7562fc9ab4c52881a57f373ed7a8f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:01.023629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:01.053686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:01.092113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf7562fc9ab4c52881a57f373ed7a8f', 'request_id': 'req-3aac6dc5-2d18-440e-a952-447fecfe4a61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.099553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf7562fc9ab4c52881a57f373ed7a8f', 'request_id': 'req-3aac6dc5-2d18-440e-a952-447fecfe4a61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.108950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf7562fc9ab4c52881a57f373ed7a8f', 'request_id': 'req-3aac6dc5-2d18-440e-a952-447fecfe4a61'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.123415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] The token cache is being invalidate because project 1cf7562fc9ab4c52881a57f373ed7a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:01.123716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.124474 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.126240 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1280/2571] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:00 2022] DELETE /identity/v3/projects/1cf7562fc9ab4c52881a57f373ed7a8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:01.130475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:01.140501 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3917902-5fcc-4fab-adae-1bce3266e056 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:01.206863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:01.207500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:01.207896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:01.208198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] PATH_INFO: `/v3/users/c53d4e72338d4a89872d2157c607e2ad` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:01.209784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53d4e72338d4a89872d2157c607e2ad)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:01.211881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:01.219479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:01.277678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53d4e72338d4a89872d2157c607e2ad'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.278332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53d4e72338d4a89872d2157c607e2ad'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.279015 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53d4e72338d4a89872d2157c607e2ad'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.286097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53d4e72338d4a89872d2157c607e2ad'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.297890 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c2f4484f-50b6-4b2e-8a88-e4c245e5b7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53d4e72338d4a89872d2157c607e2ad'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.313936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1292/2572] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:01 2022] DELETE /identity/v3/users/c53d4e72338d4a89872d2157c607e2ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:01.781107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:01.782835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:01.798707 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac6dc5-2d18-440e-a952-447fecfe4a61 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:01.876929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:01.877691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:01.878064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:01.878424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] PATH_INFO: `/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:01.879831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd3e1ce04704b4fa14e868adbe28fd1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:01.881994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:01.946659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd3e1ce04704b4fa14e868adbe28fd1', 'request_id': 'req-97f1ef52-4f91-4dd1-9a35-be75e234822f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.954556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd3e1ce04704b4fa14e868adbe28fd1', 'request_id': 'req-97f1ef52-4f91-4dd1-9a35-be75e234822f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.964287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd3e1ce04704b4fa14e868adbe28fd1', 'request_id': 'req-97f1ef52-4f91-4dd1-9a35-be75e234822f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.978127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] The token cache is being invalidate because project 3bd3e1ce04704b4fa14e868adbe28fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:01.978535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.979276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-97f1ef52-4f91-4dd1-9a35-be75e234822f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:01.980890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1281/2573] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:01 2022] DELETE /identity/v3/projects/3bd3e1ce04704b4fa14e868adbe28fd1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:01.986273 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:01.986665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:01.986996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.010413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:02.011765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:02.088184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1293/2574] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:02.096535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.097073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.097285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.119619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:02.120890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:02.130016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1282/2575] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:02.134868 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.145054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dddc4c-a421-4fc5-af73-f14ecabdc262 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.151008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.151627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.151900 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.152850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.153507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:02.153804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.155445 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.168527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1294/2576] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:02.172962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.184688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4988b64-28bf-4b00-abdc-e602b2827a5c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.190558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.191280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.191533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.192066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.192738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.194725 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.230780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1283/2577] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:02 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:02.232979 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.243519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88db2-a772-4fcc-8673-636824517c66 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.342664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.343825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.344233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.344595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.345449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.349035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.397558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.400173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1295/2578] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:02 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:02.411096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e46b63-8ebe-4280-a57c-91e4725efe60 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.426722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.427556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.428157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.428587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.429409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.432570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.440194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:02.449145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1284/2579] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:02.450465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.456288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:02.464668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea4868-a1d7-445c-abc2-e61fc20612a0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.471085 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.471955 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.472630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.473461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.474462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.476288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ede7d-3ecc-4fb1-800c-c180914af36f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.495058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1296/2580] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:02.496166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.513227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c6ee6-af5a-4a0d-b88f-00fe96f9d293 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.518330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.519320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.520259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.520638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] PATH_INFO: `/v3/projects/a79ebbf356b04ed1aa256e66f9863e56/users/9b279afa3f2d4f63aea219d0e0e44a0c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.537126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79ebbf356b04ed1aa256e66f9863e56, user_id=9b279afa3f2d4f63aea219d0e0e44a0c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.540114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.560883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1285/2581] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:02 2022] PUT /identity/v3/projects/a79ebbf356b04ed1aa256e66f9863e56/users/9b279afa3f2d4f63aea219d0e0e44a0c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:02.573012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.574402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.575160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.610020 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] MFA Rules not processed for user `9b279afa3f2d4f63aea219d0e0e44a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:02.611736 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:02.729209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1297/2582] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:02.740216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.742777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:02.805857 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd220-0663-4dc5-b63f-526610b466cc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.809588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.810270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.810546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.810812 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.821593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.823023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.831981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1286/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:02.855774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.874609 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:02.882357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:02.936631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607d3b5-8854-4cdd-9592-702d462e457b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.941853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.942005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.942275 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.942575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] PATH_INFO: `/v3/users/9b279afa3f2d4f63aea219d0e0e44a0c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.943753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b279afa3f2d4f63aea219d0e0e44a0c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.945985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:02.962402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157376a-6280-44e6-ad31-ab8700001536 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:02.968070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:02.968729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:02.969066 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:02.969402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] PATH_INFO: `/v3/users/83cdff24514c42679e46d8f5b7c27fbe` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:02.970832 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cdff24514c42679e46d8f5b7c27fbe)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:02.973687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.004449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b279afa3f2d4f63aea219d0e0e44a0c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.005219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b279afa3f2d4f63aea219d0e0e44a0c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.005884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b279afa3f2d4f63aea219d0e0e44a0c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.017254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b279afa3f2d4f63aea219d0e0e44a0c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.034923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46911406-5f38-44ab-923f-e727c4bba4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b279afa3f2d4f63aea219d0e0e44a0c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.048450 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:03.056455 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1298/2584] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:02 2022] DELETE /identity/v3/users/9b279afa3f2d4f63aea219d0e0e44a0c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:03.061380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.062244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.062925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.070901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cdff24514c42679e46d8f5b7c27fbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.082015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cdff24514c42679e46d8f5b7c27fbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.082843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cdff24514c42679e46d8f5b7c27fbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.088585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:03.090123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.097952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cdff24514c42679e46d8f5b7c27fbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.112177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cdff24514c42679e46d8f5b7c27fbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.114361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:03.124444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1287/2585] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:02 2022] DELETE /identity/v3/users/83cdff24514c42679e46d8f5b7c27fbe => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:03.163703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1299/2586] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:03.173028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.175639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.254075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed8391-c1ea-4d1a-9732-733300d1d9bd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.258325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.258952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.259228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.259499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.323372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.325021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.337386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8ea2b-0374-497f-b9e1-94db865186a0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.344181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.345274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4a837-5bb4-47d2-a66b-1c65429dabcf service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.350340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.353421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.354126 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.354503 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] PATH_INFO: `/v3/projects/b2d15d31842545709cb4b23cca72e3a0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.356374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d15d31842545709cb4b23cca72e3a0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.359226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.363956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1288/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:03.418131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d15d31842545709cb4b23cca72e3a0', 'request_id': 'req-eae82a5e-acae-48f2-9465-996e934978e9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.427555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d15d31842545709cb4b23cca72e3a0', 'request_id': 'req-eae82a5e-acae-48f2-9465-996e934978e9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.436719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d15d31842545709cb4b23cca72e3a0', 'request_id': 'req-eae82a5e-acae-48f2-9465-996e934978e9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.449331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] The token cache is being invalidate because project b2d15d31842545709cb4b23cca72e3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:03.449622 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.450550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-eae82a5e-acae-48f2-9465-996e934978e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.452438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1300/2588] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:03 2022] DELETE /identity/v3/projects/b2d15d31842545709cb4b23cca72e3a0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:03.457830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.458176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.458404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.480816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:03.482057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.562175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1289/2589] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:03.571476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.571748 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.572040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.596123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:03.597301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.611621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1301/2590] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:03.613294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.625328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4e685-bfe8-4aff-a13a-9a764edba9b0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.630856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.631999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.632288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.632560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.633567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:03.633885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.635521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.653233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1290/2591] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:03.654387 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.666327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229e10-23f9-469d-b840-5c037b8b6a92 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.686873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.688119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.688407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.688693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.689315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.691761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.702862 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.704958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.724160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd5a33-7f58-4d68-bc4d-d6a256eb1230 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.734892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.735845 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.736248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.736683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] PATH_INFO: `/v3/projects/a79ebbf356b04ed1aa256e66f9863e56` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.738032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79ebbf356b04ed1aa256e66f9863e56)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.740666 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.743066 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1302/2592] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:03.747559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.799679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:03.820343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79ebbf356b04ed1aa256e66f9863e56', 'request_id': 'req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.824707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:03.828836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79ebbf356b04ed1aa256e66f9863e56', 'request_id': 'req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.832334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7a14a-7c0a-4ad1-b33e-ae1b9cc8f613 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.837346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79ebbf356b04ed1aa256e66f9863e56', 'request_id': 'req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.850087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] The token cache is being invalidate because project a79ebbf356b04ed1aa256e66f9863e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:03.850378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.851292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7fc00c6-3059-49d9-8d6f-2661dbe5b966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:03.853172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1291/2593] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:03 2022] DELETE /identity/v3/projects/a79ebbf356b04ed1aa256e66f9863e56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:03.857947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb129b-45f3-46e2-ade8-6422bd490bad None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.858228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb129b-45f3-46e2-ade8-6422bd490bad None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.858887 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb129b-45f3-46e2-ade8-6422bd490bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.883983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3fbb129b-45f3-46e2-ade8-6422bd490bad None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:03.885487 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3fbb129b-45f3-46e2-ade8-6422bd490bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.904001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.904881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.905308 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.905828 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.906427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.908947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.932408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1303/2594] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:03.936494 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.938131 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.950733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc4feb-5e3f-4bcc-b1b5-6092e86c80b8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.955482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.956121 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.956396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.956709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.957352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.959014 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:03.962208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1292/2595] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:03.972845 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1304/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:03.973375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.973375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.973375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.974208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:03.985565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe07d-be93-415c-bd7e-bf58eab94088 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:03.993470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:03.994434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:03.994718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:03.994992 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:03.995539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:03.995651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:03.997063 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:03.997436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.006339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1293/2597] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:04.011171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.018552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1305/2598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:04.019783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.022791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0636911-05ee-4030-b727-89547e13f9e4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.029328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.030152 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.030646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.030918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.031040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee38-1d65-40b1-91fd-e447b457350a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.031564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:04.031864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.033669 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.037244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.044242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.044550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.044831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] PATH_INFO: `/v3/projects/ccf76d80cdb3440d9f9102db8d03b1f1/users/b991877fccb34ce89bcb0512bb09f461/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.047317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1294/2599] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 11:31:04.052273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.066957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b305e-e291-46f3-9626-245f0b051398 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.069563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf76d80cdb3440d9f9102db8d03b1f1, user_id=b991877fccb34ce89bcb0512bb09f461, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.072699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.072971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa9a01-f8d5-48d6-97cd-8feca1fb6018 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.073564 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.077694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.077694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.077694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.077694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.091320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1306/2600] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:04 2022] PUT /identity/v3/projects/ccf76d80cdb3440d9f9102db8d03b1f1/users/b991877fccb34ce89bcb0512bb09f461/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:04.103446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.103699 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.104124 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.108169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1295/2601] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:04 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:04.112149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.136226 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] MFA Rules not processed for user `b991877fccb34ce89bcb0512bb09f461`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:04.137520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:04.183103 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827b3-6bac-4953-b709-19aecb2a53e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.187978 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.188590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.188860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.189235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.189754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.191710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.208967 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1307/2602] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:04.219569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1296/2603] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:04 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:04.220855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.220977 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.222775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:04.231796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628150b5-f2ca-4bc6-9497-03f83d61e3ea admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.237993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.238610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.238885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.239151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.239796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.241431 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.243197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:04.256150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1297/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:04.257256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.269118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e6a98-c7bb-456d-b1c4-520ce97d9d77 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.275875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.276843 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.277117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.278579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.279367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.281332 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.292535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:04.306256 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1298/2605] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:04.312300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.341054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ec0fd-2bf3-41d6-ad77-74f48ff85ff0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.346793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.347808 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.349448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.349945 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] PATH_INFO: `/v3/projects/7951b8e9bb9e4b98baab81747ba215d5/users/8baefa52da5048cea3fa6549608c3359/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.370172 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d41b79-2dd6-40b5-bbf8-ee04c9ef8c7a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.376576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.377208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.377488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.377915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.388176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7951b8e9bb9e4b98baab81747ba215d5, user_id=8baefa52da5048cea3fa6549608c3359, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.391877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68876094-9288-470a-a63e-605f712bc09a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.393613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.395327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.407293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1308/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:31:04.412276 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1299/2607] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:04 2022] PUT /identity/v3/projects/7951b8e9bb9e4b98baab81747ba215d5/users/8baefa52da5048cea3fa6549608c3359/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:04.424192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3b005-3cd8-49df-86c2-75c354d753fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.424543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3b005-3cd8-49df-86c2-75c354d753fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.425035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3b005-3cd8-49df-86c2-75c354d753fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.472020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b8b3b005-3cd8-49df-86c2-75c354d753fe None None] MFA Rules not processed for user `8baefa52da5048cea3fa6549608c3359`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:04.472020 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8b3b005-3cd8-49df-86c2-75c354d753fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:04.545093 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1300/2608] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:04.557192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:04.558869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:04.636095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eca1b-3e35-40eb-b38b-d08ff0bb360b service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:04.697621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:04.698352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:04.698662 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:04.698904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:04.708682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:04.710460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:04.723940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1309/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:06.240143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:06.240593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:06.240593 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:06.261404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:06.262630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:06.321064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1301/2610] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:31:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:06.333641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:06.335106 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:06.405380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:06.412729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769ec91-b31d-4122-bce4-1b81ea991a6d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:06.418872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:06.419540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:06.419817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:06.420139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:06.428889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:06.430554 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4219-cf0c-470e-8a55-9ed195469536 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:06.438964 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1310/2611] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:31:08.123077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:08.191811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:08.198469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4917d1-b86a-40d0-a6ab-e5347b81cc4d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:08.204435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:08.205461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:08.205987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:08.206605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] PATH_INFO: `/v3/users/8baefa52da5048cea3fa6549608c3359` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:08.208313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baefa52da5048cea3fa6549608c3359)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:08.210605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:08.265026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baefa52da5048cea3fa6549608c3359'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:08.274548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baefa52da5048cea3fa6549608c3359'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:08.275221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baefa52da5048cea3fa6549608c3359'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:08.283646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baefa52da5048cea3fa6549608c3359'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:08.297619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baefa52da5048cea3fa6549608c3359'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:08.306859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1302/2612] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:08 2022] DELETE /identity/v3/users/8baefa52da5048cea3fa6549608c3359 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:08.310693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:08.311206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:08.311334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:08.331877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:08.333128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:08.403256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1311/2613] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:08.413204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:08.415133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:08.512856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22668db-cbee-4e07-83fd-0579d31a3272 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:08.518640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:08.519274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:08.519555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:08.519828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:08.536250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:08.537714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:08.548935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1303/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:08.901610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:08.903335 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:08.921512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1cfa-4139-43c8-b2c0-e4b418673e0b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:08.934678 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:08.944472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:08.944774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:08.945185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] PATH_INFO: `/v3/projects/7951b8e9bb9e4b98baab81747ba215d5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:08.947055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7951b8e9bb9e4b98baab81747ba215d5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:08.949190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:09.016629 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7951b8e9bb9e4b98baab81747ba215d5', 'request_id': 'req-11155f77-9a55-4041-a98f-1fe810086688'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.025162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7951b8e9bb9e4b98baab81747ba215d5', 'request_id': 'req-11155f77-9a55-4041-a98f-1fe810086688'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.032117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7951b8e9bb9e4b98baab81747ba215d5', 'request_id': 'req-11155f77-9a55-4041-a98f-1fe810086688'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.043718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] The token cache is being invalidate because project 7951b8e9bb9e4b98baab81747ba215d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:09.044041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.044768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11155f77-9a55-4041-a98f-1fe810086688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.046476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1312/2615] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:08 2022] DELETE /identity/v3/projects/7951b8e9bb9e4b98baab81747ba215d5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:09.848976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:09.849450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:09.863202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81a197-e4dc-4624-85bd-3f6911be208b service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:09.927140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:09.927790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:09.928241 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:09.928516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] PATH_INFO: `/v3/users/b991877fccb34ce89bcb0512bb09f461` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:09.930507 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b991877fccb34ce89bcb0512bb09f461)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:09.932538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:09.960033 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:09.989932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b991877fccb34ce89bcb0512bb09f461'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:09.999814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b991877fccb34ce89bcb0512bb09f461'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.000531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b991877fccb34ce89bcb0512bb09f461'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.010623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b991877fccb34ce89bcb0512bb09f461'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.023164 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b991877fccb34ce89bcb0512bb09f461'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.030162 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1304/2616] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:09 2022] DELETE /identity/v3/users/b991877fccb34ce89bcb0512bb09f461 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:10.034974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.035523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.035523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.057409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:10.058633 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:10.122481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1313/2617] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:10.132912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:10.134819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:10.203877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1565e8-2865-4d5c-96b2-dd172942a6df admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:10.207936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:10.208570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.208844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.209148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.220172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:10.222013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc60f93-7e38-4496-b0fb-de2394f8d0ef service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:10.234533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1305/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:10.652436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:10.653950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:10.669065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf3028-c460-4a8b-98d6-4d9cb8fb6eb3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:10.680605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:10.681454 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.681969 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.688327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] PATH_INFO: `/v3/projects/ccf76d80cdb3440d9f9102db8d03b1f1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.689729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf76d80cdb3440d9f9102db8d03b1f1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:10.692285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:10.702079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:10.765330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf76d80cdb3440d9f9102db8d03b1f1', 'request_id': 'req-44127c77-f251-42b2-a881-046bf870ee2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.780247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf76d80cdb3440d9f9102db8d03b1f1', 'request_id': 'req-44127c77-f251-42b2-a881-046bf870ee2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.790115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf76d80cdb3440d9f9102db8d03b1f1', 'request_id': 'req-44127c77-f251-42b2-a881-046bf870ee2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.802089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] The token cache is being invalidate because project ccf76d80cdb3440d9f9102db8d03b1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:10.802518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.803272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-44127c77-f251-42b2-a881-046bf870ee2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:10.805274 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1314/2619] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:10 2022] DELETE /identity/v3/projects/ccf76d80cdb3440d9f9102db8d03b1f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:10.810144 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.810872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.811148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.833683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:10.834918 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:10.902168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1306/2620] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:10.906381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.906727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.907097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.929076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:10.930715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:10.940021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1315/2621] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:10.944402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:10.954925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1eb2b-b850-47ac-becb-c0b376f04c73 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:10.964533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:10.965267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:10.965523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:10.965839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:10.966460 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:10.966767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:10.968430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:10.982928 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1307/2622] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:10.987493 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:10.998496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459b054-217a-4403-8ace-9a14cbb1e4e9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.004276 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.004984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.005333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.005714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.006415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.008802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.039794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1316/2623] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:10 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:11.044034 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.055040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb709243-88ff-4afd-b141-beade9ded302 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.081410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:11.118414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.119067 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.119419 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.119712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.120371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.122373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.151430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1308/2624] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:11 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:11.152940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.164834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808437-313b-46b9-acd6-0752b757ed87 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.170219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.171022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.171372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.171819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.172764 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.174619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.188904 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1317/2625] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:11.195054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.209540 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c2dc-6fae-46b2-be38-9b3d7f98d142 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.216189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.217096 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.217966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.218471 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.219299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.221951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1528a1-bb66-400f-a91d-7068450656d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.236724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1309/2626] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:11.240759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.251446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8dca7-6624-4247-ba08-7cdea5f920f0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.256209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.256879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.257155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.257456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] PATH_INFO: `/v3/projects/f89a5d40c61043c099c16d513af604e2/users/5decb88b20704415bf19dff514b96d7f/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.273430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89a5d40c61043c099c16d513af604e2, user_id=5decb88b20704415bf19dff514b96d7f, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.276334 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.296145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1318/2627] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:11 2022] PUT /identity/v3/projects/f89a5d40c61043c099c16d513af604e2/users/5decb88b20704415bf19dff514b96d7f/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:11.309520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.310010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.310472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.340344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] MFA Rules not processed for user `5decb88b20704415bf19dff514b96d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:11.341790 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:11.424437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1310/2628] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:11.429159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.497289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb5a4-51a2-4afd-a3f8-e48a68a4b57a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.502048 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.502666 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.502938 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.503205 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.503879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.505835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.535465 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1319/2629] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:11 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:11.540656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.552911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071b844-3d4b-499e-9841-b8f9f1d1eb75 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.643339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.644157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.644450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.644758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.645400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.647551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.683981 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1311/2630] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:11 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:11.685971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.699695 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45e98c-5cb0-45b8-b78f-32ef2d30d14e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.729723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.730650 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.731027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.731399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.732476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.742296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.764706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:11.769005 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.789730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d47b8-6e52-48be-97d7-47b54b90887a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.795692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.796412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.796694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.796970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] PATH_INFO: `/v3/projects/698dc6849c4e4ab19e67e5480b480b35/users/c2c1795173b94f43ab6e41fca079f8a4/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.815054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=698dc6849c4e4ab19e67e5480b480b35, user_id=c2c1795173b94f43ab6e41fca079f8a4, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.817789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.833019 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1312/2632] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:11 2022] PUT /identity/v3/projects/698dc6849c4e4ab19e67e5480b480b35/users/c2c1795173b94f43ab6e41fca079f8a4/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:11.833291 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:11.837585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.848426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d90b-0fb3-407e-a031-31fc2967870f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.852443 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:11.920702 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.921486 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.921855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.922230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.923063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.924793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781263-b4d4-4df7-bb06-3df8e796cc02 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.935612 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1321/2633] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:11.939853 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:11.951546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7527-11ad-4cb4-9777-b23bebe3ca5e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:11.956275 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:11.956942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.957221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.957494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] PATH_INFO: `/v3/projects/698dc6849c4e4ab19e67e5480b480b35/users/c2c1795173b94f43ab6e41fca079f8a4/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:11.959443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698dc6849c4e4ab19e67e5480b480b35, user_id=c2c1795173b94f43ab6e41fca079f8a4, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:11.962300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:11.974783 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1313/2634] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:11 2022] PUT /identity/v3/projects/698dc6849c4e4ab19e67e5480b480b35/users/c2c1795173b94f43ab6e41fca079f8a4/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:11.985543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:11.985826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:11.986097 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:12.032639 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] MFA Rules not processed for user `c2c1795173b94f43ab6e41fca079f8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:12.033782 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:12.109105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1322/2635] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:12.119304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:12.121477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:12.197098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731ad8c-c991-4812-88c3-44383c983f53 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:12.200958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:12.201644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:12.201987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:12.202371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:12.213176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:12.214729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:12.226201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1314/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:12.310754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:12.322355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa788-98d7-4e6d-9c55-56e7bc275082 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:12.326103 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:12.326735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:12.327056 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:12.327331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:12.392190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:12.393742 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389531af-8b73-4bcb-ac8c-d55b829ce450 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:12.404375 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1323/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:19.713537 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:19.779452 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8183d9-6496-46fc-b265-f626df2074bc service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:19.785424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:19.786059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:19.786329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:19.786597 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] PATH_INFO: `/v3/users/5decb88b20704415bf19dff514b96d7f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:19.787890 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5decb88b20704415bf19dff514b96d7f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:19.789838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:19.837235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5decb88b20704415bf19dff514b96d7f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:19.845415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5decb88b20704415bf19dff514b96d7f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:19.846146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5decb88b20704415bf19dff514b96d7f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:19.853447 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5decb88b20704415bf19dff514b96d7f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:19.865768 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5decb88b20704415bf19dff514b96d7f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:19.872088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:19 2022] DELETE /identity/v3/users/5decb88b20704415bf19dff514b96d7f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:19.876759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:19.877289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:19.877289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:19.898596 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:19.899872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:19.922774 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:20.094257 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1324/2639] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:20.104591 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:20.106328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:20.117293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:20.170531 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd82c-e5c4-433e-b753-2fd45535eebc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:20.174558 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:20.175173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:20.175445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:20.175711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:20.185377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:20.186811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:20.196659 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1316/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:20.482840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:20.484329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:20.497605 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fedca-c128-49ab-b15c-97fb7c4cc3be None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:20.502973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:20.503611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:20.503880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:20.504188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] PATH_INFO: `/v3/projects/f89a5d40c61043c099c16d513af604e2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:20.505566 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89a5d40c61043c099c16d513af604e2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:20.507497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:20.557240 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89a5d40c61043c099c16d513af604e2', 'request_id': 'req-5fd7c439-8446-4eaa-ada3-6579c2b11379'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.566253 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89a5d40c61043c099c16d513af604e2', 'request_id': 'req-5fd7c439-8446-4eaa-ada3-6579c2b11379'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.573152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89a5d40c61043c099c16d513af604e2', 'request_id': 'req-5fd7c439-8446-4eaa-ada3-6579c2b11379'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.583779 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] The token cache is being invalidate because project f89a5d40c61043c099c16d513af604e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:20.584095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.584752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.586208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1325/2641] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:20 2022] DELETE /identity/v3/projects/f89a5d40c61043c099c16d513af604e2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:20.590355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:20.601054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4879563-aa5f-46bc-b941-3bc46ffdcf62 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:20.661406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:20.662042 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:20.662315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:20.662580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] PATH_INFO: `/v3/users/c2c1795173b94f43ab6e41fca079f8a4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:20.663863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c1795173b94f43ab6e41fca079f8a4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:20.665940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:20.719141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c1795173b94f43ab6e41fca079f8a4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.728470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c1795173b94f43ab6e41fca079f8a4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.729334 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c1795173b94f43ab6e41fca079f8a4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.737654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c1795173b94f43ab6e41fca079f8a4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.752728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-945dff21-8202-46f4-8096-9130a071e06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c1795173b94f43ab6e41fca079f8a4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:20.758700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1317/2642] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:20 2022] DELETE /identity/v3/users/c2c1795173b94f43ab6e41fca079f8a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:21.048937 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.050556 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:21.066267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7c439-8446-4eaa-ada3-6579c2b11379 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.132789 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.133440 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.133773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.134439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] PATH_INFO: `/v3/projects/698dc6849c4e4ab19e67e5480b480b35` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.135480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=698dc6849c4e4ab19e67e5480b480b35)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.137470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.188116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698dc6849c4e4ab19e67e5480b480b35', 'request_id': 'req-53770c62-ad10-40ed-93b0-ed4ca405ef8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:21.190766 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:21.201259 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698dc6849c4e4ab19e67e5480b480b35', 'request_id': 'req-53770c62-ad10-40ed-93b0-ed4ca405ef8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:21.211903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698dc6849c4e4ab19e67e5480b480b35', 'request_id': 'req-53770c62-ad10-40ed-93b0-ed4ca405ef8c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:21.224613 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] The token cache is being invalidate because project 698dc6849c4e4ab19e67e5480b480b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:21.224948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:21.225611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-53770c62-ad10-40ed-93b0-ed4ca405ef8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:21.227384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1326/2643] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:21 2022] DELETE /identity/v3/projects/698dc6849c4e4ab19e67e5480b480b35 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:21.232751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.233040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.233318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.255146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:21.256502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:21.289351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:21.328168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1318/2644] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:21.337644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.338401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.338401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.368233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:21.369532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:21.381664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1327/2645] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:21.385190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.395526 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b9738-a722-4f3f-a440-355ac59167cb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.401182 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.401842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.402189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.402463 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.403146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:21.403448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.405070 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.417633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1319/2646] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:21.422161 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.432565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee683d-9067-4ad2-a653-14c7aa5e9f87 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.438206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.438923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.439468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.439840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.440815 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.442899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.471313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1328/2647] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:21.475993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.486723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb3b4-c4b2-4ccc-982e-f23b622f9378 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.557566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.558190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.558466 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.558746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.559376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.561353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.585213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1320/2648] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:21.589099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.600421 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb1b6e-72e4-4f7d-9c69-764397a59a50 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.606195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.606829 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.607107 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.607379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.608071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.609672 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.620330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1329/2649] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:21.624534 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.634913 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367adc75-3e10-4c85-9133-2b26df732715 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.640396 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.640997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.641273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.641541 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.642186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.643796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64e99c-6c1f-46ef-a796-97251360c57a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.654533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1321/2650] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:21.659270 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.674057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf980-0465-4192-bf8e-358cb5084137 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.680199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.680846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.681243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.681475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] PATH_INFO: `/v3/projects/0888db9d4eb84331b258071e74fcdd63/users/8fe75deba7704d36a3b3a9abc6eb679e/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.696389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0888db9d4eb84331b258071e74fcdd63, user_id=8fe75deba7704d36a3b3a9abc6eb679e, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.699179 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.717280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1330/2651] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:21 2022] PUT /identity/v3/projects/0888db9d4eb84331b258071e74fcdd63/users/8fe75deba7704d36a3b3a9abc6eb679e/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:21.728766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.729310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.729310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.759497 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] MFA Rules not processed for user `8fe75deba7704d36a3b3a9abc6eb679e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:21.760753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:21.836131 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1322/2652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:21.840921 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.908254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad838-e6fd-4fa9-a3fa-30b747f9899b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:21.916290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:21.916905 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:21.917177 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:21.917442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:21.918055 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:21.919944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:21.947960 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1331/2653] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:21.953137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:21.967863 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c8167-7add-4028-ba01-c59aaff48251 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.001911 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:22.039389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.040163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.040340 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.040619 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.041251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.043233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.068516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1323/2654] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:21 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:22.073234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:22.085245 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185135a-4860-409d-8fcc-2b93e8b79f5c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.091543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.092173 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.092451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.092720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.093401 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.095058 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.109075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1332/2655] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:22.113379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:22.124299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4e38-e610-43c8-ab93-8168bbc4ff96 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.129098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.129766 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.130041 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.130310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] PATH_INFO: `/v3/projects/0f748c258be646998de24dcd48f3c20a/users/3648d05a5ba7450d97957046f2240162/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.145025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f748c258be646998de24dcd48f3c20a, user_id=3648d05a5ba7450d97957046f2240162, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.147662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.162173 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1324/2656] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:22 2022] PUT /identity/v3/projects/0f748c258be646998de24dcd48f3c20a/users/3648d05a5ba7450d97957046f2240162/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:22.166411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:22.176665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162468b-1e81-4117-8a17-c9aaa7876a23 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.226436 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:22.241950 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.243269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.243630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.243903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.244667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.246420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dcf2-876a-49a8-a0e0-10a402e2395f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.256456 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1333/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:22.260850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:22.271494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d795d-0a29-41a4-81a0-6615332d7df1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.276625 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.277273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.277547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.277816 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] PATH_INFO: `/v3/projects/0f748c258be646998de24dcd48f3c20a/users/3648d05a5ba7450d97957046f2240162/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.279856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f748c258be646998de24dcd48f3c20a, user_id=3648d05a5ba7450d97957046f2240162, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.282506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.293190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1325/2658] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:22 2022] PUT /identity/v3/projects/0f748c258be646998de24dcd48f3c20a/users/3648d05a5ba7450d97957046f2240162/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:22.303474 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec162aa-54ee-4599-97ad-fe2339c815eb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.303755 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec162aa-54ee-4599-97ad-fe2339c815eb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.304059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec162aa-54ee-4599-97ad-fe2339c815eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.339441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6ec162aa-54ee-4599-97ad-fe2339c815eb None None] MFA Rules not processed for user `3648d05a5ba7450d97957046f2240162`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:22.340688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6ec162aa-54ee-4599-97ad-fe2339c815eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:22.413577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1334/2659] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:22.425875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:22.427620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:22.488641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d2566-4560-4a1b-af8c-dc80790a0e12 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:22.491995 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:22.492630 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:22.492908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:22.493172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:22.551651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:22.553145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:22.562947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1326/2660] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:23.312137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:23.312647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:23.312647 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:23.337384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:23.338576 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:23.397882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1335/2661] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:23.411972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:23.414286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:23.456799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:23.496026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2487005-dbb2-407a-8f29-ac99171c7c60 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:23.501588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:23.502227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:23.502508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:23.502779 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:23.511197 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:23.512830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:23.520699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1327/2662] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:31:23.942762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:23.944359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:23.960349 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3384c-66f9-4515-85f5-b242d74b330d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:23.964509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:23.965111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:23.965383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:23.965641 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:23.975485 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:23.976984 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8632f-cf8e-47d9-9b03-cfa9f32f155a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:23.986027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1336/2663] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:27.791468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:27.860118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba217e-7e17-4407-82bf-13ed52a18b94 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:27.865136 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:27.865762 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:27.866037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:27.866301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] PATH_INFO: `/v3/users/8fe75deba7704d36a3b3a9abc6eb679e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:27.867464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe75deba7704d36a3b3a9abc6eb679e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:27.869402 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:27.921846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe75deba7704d36a3b3a9abc6eb679e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:27.931004 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe75deba7704d36a3b3a9abc6eb679e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:27.931638 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe75deba7704d36a3b3a9abc6eb679e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:27.939500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe75deba7704d36a3b3a9abc6eb679e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:27.952444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe75deba7704d36a3b3a9abc6eb679e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:27.958656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1328/2664] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:27 2022] DELETE /identity/v3/users/8fe75deba7704d36a3b3a9abc6eb679e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:27.963169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:27.963632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:27.963744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:27.985390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:27.986597 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:28.050389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1337/2665] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:28.061180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:28.063550 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:28.123806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:28.138444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a65f4-4709-4085-972f-c790f83fbbc1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:28.142407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:28.143018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:28.143329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:28.143594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:28.152886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:28.154227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:28.163308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1329/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:28.452892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:28.454468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:28.463242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:28.467577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68aa606-7232-474e-9069-dfe64a98c660 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:28.473410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:28.474147 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:28.474521 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:28.474885 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] PATH_INFO: `/v3/projects/0888db9d4eb84331b258071e74fcdd63` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:28.476073 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0888db9d4eb84331b258071e74fcdd63)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:28.478007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:28.535606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0888db9d4eb84331b258071e74fcdd63', 'request_id': 'req-69e9bcf8-7d7c-4477-8890-14b248df55d6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.548894 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0888db9d4eb84331b258071e74fcdd63', 'request_id': 'req-69e9bcf8-7d7c-4477-8890-14b248df55d6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.557986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0888db9d4eb84331b258071e74fcdd63', 'request_id': 'req-69e9bcf8-7d7c-4477-8890-14b248df55d6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.576139 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] The token cache is being invalidate because project 0888db9d4eb84331b258071e74fcdd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:28.576338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.577067 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.578624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1338/2667] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:28 2022] DELETE /identity/v3/projects/0888db9d4eb84331b258071e74fcdd63 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:28.582968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:28.593028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f330-d950-4e68-a7fe-cc5837ca6968 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:28.654510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:28.655156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:28.655430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:28.655691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] PATH_INFO: `/v3/users/3648d05a5ba7450d97957046f2240162` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:28.656876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3648d05a5ba7450d97957046f2240162)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:28.658847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:28.709300 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3648d05a5ba7450d97957046f2240162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.717361 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3648d05a5ba7450d97957046f2240162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.717955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3648d05a5ba7450d97957046f2240162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.725292 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3648d05a5ba7450d97957046f2240162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.740271 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09c5f9ba-74d2-4565-ba1f-fecbfc7180af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3648d05a5ba7450d97957046f2240162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:28.746328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1330/2668] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:28 2022] DELETE /identity/v3/users/3648d05a5ba7450d97957046f2240162 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:29.041389 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.043021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:29.057340 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9bcf8-7d7c-4477-8890-14b248df55d6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.117769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.118329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.118608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.118882 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] PATH_INFO: `/v3/projects/0f748c258be646998de24dcd48f3c20a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.120089 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f748c258be646998de24dcd48f3c20a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.122010 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.168919 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f748c258be646998de24dcd48f3c20a', 'request_id': 'req-c98aa020-7930-47f4-9c75-6aef4582b5d8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:29.177536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f748c258be646998de24dcd48f3c20a', 'request_id': 'req-c98aa020-7930-47f4-9c75-6aef4582b5d8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:29.183744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f748c258be646998de24dcd48f3c20a', 'request_id': 'req-c98aa020-7930-47f4-9c75-6aef4582b5d8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:29.194408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] The token cache is being invalidate because project 0f748c258be646998de24dcd48f3c20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:29.194692 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:29.195362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c98aa020-7930-47f4-9c75-6aef4582b5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:29.196886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1339/2669] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:29 2022] DELETE /identity/v3/projects/0f748c258be646998de24dcd48f3c20a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:29.203629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.204151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.204265 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.225306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:29.226536 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:29.287028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1331/2670] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:29.296310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.296649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.297004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.324065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:29.325733 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:29.334404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1340/2671] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:29.338898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.345088 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:29.349472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce5ef8-d2ec-4fd5-ad7e-4e77e63cee95 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.355430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.356081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.356355 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.356644 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.357280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:29.357629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.359730 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.371170 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1332/2672] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:29.375703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.385038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c423a-421e-4e41-800b-c5bdc0c48b94 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.391323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.391945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.392233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.392498 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.393136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.395045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.405415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:29.425757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1341/2673] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:29 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:29.431908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.443731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1835eb3-ab1b-42f4-a4cd-91dd747915e7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.503211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.503814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.504119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.504395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.505010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.506933 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.540968 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1333/2674] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:29 2022] POST /identity/v3/users => generated 280 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:29.545985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.562246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6daf-749a-4b45-a6ae-c011897911b8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.568208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.568807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.569075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.569341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.569973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.571561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.581807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1342/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:29.585884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.597383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06236d-43ae-456a-9d45-31f9fe8f07cb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.602565 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.603167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.603449 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.603722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.604407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.606017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a0dce-5ad7-4858-81a0-73bc2df0aa41 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.616935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1334/2676] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:31:29.621332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.631800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aef6-fbe0-4f90-9baa-cc721588e77a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.637688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.638333 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.638609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.638952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] PATH_INFO: `/v3/projects/6bb4efe29b93412e8a7123c623a23dd0/users/a871d11fb0644ce882bc2425487cd8fb/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.654515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb4efe29b93412e8a7123c623a23dd0, user_id=a871d11fb0644ce882bc2425487cd8fb, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.657429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.678744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1343/2677] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:29 2022] PUT /identity/v3/projects/6bb4efe29b93412e8a7123c623a23dd0/users/a871d11fb0644ce882bc2425487cd8fb/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:29.692143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.692439 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.692712 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.721074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] MFA Rules not processed for user `a871d11fb0644ce882bc2425487cd8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:29.722617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:29.791069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1335/2678] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:29.824199 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.826515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:29.885229 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30b7e-be34-4192-a3d8-95c7248abee9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.889322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.889934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.890209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.890475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.898681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.900111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8798d-4cc6-43c3-9314-82f1e036e979 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:29.909127 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1344/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:29.924335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:29.988910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7ee6-6b28-482b-808c-a72aa90823be None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:29.994022 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:29.994661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:29.994917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:29.995194 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] PATH_INFO: `/v3/users/a871d11fb0644ce882bc2425487cd8fb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:29.996382 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a871d11fb0644ce882bc2425487cd8fb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:29.998504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:30.000207 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:30.049295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a871d11fb0644ce882bc2425487cd8fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.058064 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a871d11fb0644ce882bc2425487cd8fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.058798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a871d11fb0644ce882bc2425487cd8fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.066765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a871d11fb0644ce882bc2425487cd8fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.080372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a871d11fb0644ce882bc2425487cd8fb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.086709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1336/2680] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:29 2022] DELETE /identity/v3/users/a871d11fb0644ce882bc2425487cd8fb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:30.091579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.092234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.092234 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.115863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:30.117132 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:30.177078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1345/2681] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:30.187873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:30.190190 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:30.260267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a604ee2-2f64-4521-afa4-aaa00c410f24 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:30.264776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:30.265398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.265722 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.265997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.275420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:30.276925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f3b6-943c-4bf6-abe7-19fb6e916a8f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:30.286746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1337/2682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:30.580424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:30.581895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:30.594928 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f081b2-6114-4f7b-a9c9-f131f52965ce None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:30.604221 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:30.604826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.605100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.605367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] PATH_INFO: `/v3/projects/6bb4efe29b93412e8a7123c623a23dd0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.606568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb4efe29b93412e8a7123c623a23dd0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:30.608800 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:30.655878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb4efe29b93412e8a7123c623a23dd0', 'request_id': 'req-9fd5bac2-a163-44fd-9da8-73100cdd9db5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.658441 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:30.664368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb4efe29b93412e8a7123c623a23dd0', 'request_id': 'req-9fd5bac2-a163-44fd-9da8-73100cdd9db5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.672345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb4efe29b93412e8a7123c623a23dd0', 'request_id': 'req-9fd5bac2-a163-44fd-9da8-73100cdd9db5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.683204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] The token cache is being invalidate because project 6bb4efe29b93412e8a7123c623a23dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:30.683495 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.684303 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9fd5bac2-a163-44fd-9da8-73100cdd9db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:30.685847 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1346/2683] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:30 2022] DELETE /identity/v3/projects/6bb4efe29b93412e8a7123c623a23dd0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:30.690876 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.691180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.691454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.711606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:30.712856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:30.783818 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1338/2684] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:30.793125 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.793411 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.793684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.816150 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:30.817412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:30.827117 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1347/2685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:30.831503 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:30.841562 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30c1e-e171-4bbc-aebe-ce8f525580db None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:30.847075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:30.847811 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.848122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.848409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.849047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:30.849343 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:30.850944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:30.862802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1339/2686] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:30.867123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:30.876848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4031-a383-4e47-9045-886d63c78d99 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:30.882170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:30.882768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.883046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.883315 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.883998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:30.885862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:30.914467 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1348/2687] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:30 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:30.918691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:30.928765 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f274a58-8954-4f8b-9ef5-f3350bd9a8c7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:30.933408 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:30.990151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:30.990699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:30.990969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:30.991238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:30.991850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:30.993807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:31.023227 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1340/2688] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:30 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:31.028355 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:31.039479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315035-c07e-454b-b656-0dd78d60ef61 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:31.044728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:31.045302 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:31.045574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:31.045842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:31.046482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:31.048165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:31.058156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1349/2689] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:31.062453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:31.072824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f5f44-1ff8-4382-9d6b-808ea2cb66ff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:31.078415 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:31.079007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:31.079289 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:31.079559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:31.080244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:31.081841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7e3f6-1ed6-4068-95e9-a978f82ad29a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:31.092642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1341/2690] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:31.098584 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:31.109860 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924788a-fd46-41a9-82d3-5bcee6a99ea9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:31.114901 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:31.115544 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:31.115822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:31.116137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] PATH_INFO: `/v3/projects/738b24cab1ad467ab05b90ac6e45ca66/users/3012782f5f3746b89900d3e96fb07ad0/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:31.131802 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738b24cab1ad467ab05b90ac6e45ca66, user_id=3012782f5f3746b89900d3e96fb07ad0, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:31.134479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:31.149512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1350/2691] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:31 2022] PUT /identity/v3/projects/738b24cab1ad467ab05b90ac6e45ca66/users/3012782f5f3746b89900d3e96fb07ad0/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:31.160081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:31.160365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:31.160639 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:31.187824 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] MFA Rules not processed for user `3012782f5f3746b89900d3e96fb07ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:31.189060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:31.257138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1342/2692] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:31.268758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:31.270688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:31.329668 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d13d52-dc1e-4f6a-813e-7c10647ad735 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:31.334793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:31.335404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:31.335685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:31.335995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:31.345651 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:31.347403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63db97-00d3-4582-ae8e-58aa7d2782e4 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:31.356497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1351/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:41.254321 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:41.352246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:44.041391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:44.110056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da261d-6f12-46e4-a496-b7f283c67e07 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:44.115171 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:44.115789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.116092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.116356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] PATH_INFO: `/v3/users/3012782f5f3746b89900d3e96fb07ad0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.117513 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3012782f5f3746b89900d3e96fb07ad0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:44.119424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:44.181683 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3012782f5f3746b89900d3e96fb07ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.190294 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3012782f5f3746b89900d3e96fb07ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.191057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3012782f5f3746b89900d3e96fb07ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.198307 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3012782f5f3746b89900d3e96fb07ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.209919 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3012782f5f3746b89900d3e96fb07ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.216539 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1343/2694] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:44 2022] DELETE /identity/v3/users/3012782f5f3746b89900d3e96fb07ad0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:44.221512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.222050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.222050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.242442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:44.243667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:44.319739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1352/2695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:44.329965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:44.331743 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:44.399212 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecf65d-e62f-43a7-9704-230de669504c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:44.403946 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:44.404598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.404874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.405143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.415013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:44.416502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290f9da-2a5b-4b7f-a5e4-2a1ede488653 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:44.425970 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1344/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:44.706098 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:44.707747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:44.720661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5300599-3180-4d54-8bd1-3402eb4c49dd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:44.733910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:44.734573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.734856 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.735137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] PATH_INFO: `/v3/projects/738b24cab1ad467ab05b90ac6e45ca66` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.736507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738b24cab1ad467ab05b90ac6e45ca66)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:44.738806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:44.790635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738b24cab1ad467ab05b90ac6e45ca66', 'request_id': 'req-c55d2187-b1a9-469f-b48d-ae15110d8863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.803368 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738b24cab1ad467ab05b90ac6e45ca66', 'request_id': 'req-c55d2187-b1a9-469f-b48d-ae15110d8863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.812706 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738b24cab1ad467ab05b90ac6e45ca66', 'request_id': 'req-c55d2187-b1a9-469f-b48d-ae15110d8863'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.825311 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] The token cache is being invalidate because project 738b24cab1ad467ab05b90ac6e45ca66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:44.825601 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.826324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c55d2187-b1a9-469f-b48d-ae15110d8863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:44.828003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1353/2697] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:44 2022] DELETE /identity/v3/projects/738b24cab1ad467ab05b90ac6e45ca66 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:44.833500 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.833786 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.834028 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.854728 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:44.855932 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:44.873896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:44.917657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1345/2698] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:44.925760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.925943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.926194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.946288 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:44.947489 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:44.955908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1354/2699] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:44.960118 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:44.969920 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7f199-c5d9-4d8b-8b70-ee5c0ada88df None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:44.975344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:44.975956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:44.976228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:44.976492 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:44.977128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:44.977424 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:44.979013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:44.991401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1346/2700] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:44.995669 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.005491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185239c4-d188-4ea8-bb3b-8b4f8c330fe9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.011154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.011762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.012069 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.012331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.012951 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.014841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.050707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1355/2701] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:44 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:45.055035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.065726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c895b36-5750-4f1d-809c-73b9a87a6071 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.123357 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.123947 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.124258 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.124525 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.125151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.127082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.151467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1347/2702] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:45.155867 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.166648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68636595-1462-4d41-851e-7e819e41e363 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.171615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.172233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.172514 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.172785 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.173431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.175034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.185795 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1356/2703] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:45.189727 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.200483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528b0dd-3882-4159-8df7-ff0bc713f436 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.206544 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.207192 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.207350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.207642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.208317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.209925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacfbdd-847d-44a9-a81e-a53ee57a9137 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.221060 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1348/2704] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:45.225432 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.236077 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ecb00-8c78-459d-b7e9-a58df58bd4f3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.242287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.242935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.243219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.243487 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] PATH_INFO: `/v3/projects/ad9202ae49b54b4c8d0b987dd9694bce/users/f5b429f885a4410fa5dbb846172b5039/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.259759 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9202ae49b54b4c8d0b987dd9694bce, user_id=f5b429f885a4410fa5dbb846172b5039, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.262480 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.278217 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1357/2705] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:45 2022] PUT /identity/v3/projects/ad9202ae49b54b4c8d0b987dd9694bce/users/f5b429f885a4410fa5dbb846172b5039/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:45.290699 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.291009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.291380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.323091 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] MFA Rules not processed for user `f5b429f885a4410fa5dbb846172b5039`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:45.324366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:45.396618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1349/2706] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:45.401343 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.423399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:45.478299 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c489d-5617-4d94-b7f9-617c27666614 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.483083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.483703 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.484000 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.484290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.484915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.486814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.516112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1358/2707] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:45.521885 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.533493 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d738a3-a35e-4355-8e2a-b3ae6f9cc6e8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.547211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:45.594475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.595083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.595356 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.595975 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.596620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.599078 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.629236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1350/2708] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:45.633887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.644877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b17345-adc5-46c5-aba4-60e660d3fe6d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.650241 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.650876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.651203 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.651473 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.652148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.653724 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.664780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1359/2709] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:45.668749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.679050 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fdaa5-ee58-4833-b614-efd0a5fdf2cc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.685214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.685819 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.686094 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.686368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.687026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.688672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c6718-cb79-4bc0-a799-24461305046a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.699148 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1351/2710] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:45.703628 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.714749 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f5bc0-3fc1-442f-8860-3742d4ede3d6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.720400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.721419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.721691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.721957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] PATH_INFO: `/v3/projects/18a6f3c9a0874d2981602bf448f1832e/users/292ca1ee6b5b47058cf069152eaf2e30/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.737490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a6f3c9a0874d2981602bf448f1832e, user_id=292ca1ee6b5b47058cf069152eaf2e30, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.741170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.756472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1360/2711] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:45 2022] PUT /identity/v3/projects/18a6f3c9a0874d2981602bf448f1832e/users/292ca1ee6b5b47058cf069152eaf2e30/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:45.766923 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.767233 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.767510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.796418 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] MFA Rules not processed for user `292ca1ee6b5b47058cf069152eaf2e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:45.797643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:45.880886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1352/2712] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:45.885637 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:45.949930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09e41e-b2aa-404d-866f-717d3642b034 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:45.955700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:45.956574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:45.956899 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:45.957242 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:45.957866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:45.959751 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:45.990449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1361/2713] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:45.996892 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.012972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902b80-a84b-45a7-97a9-a6e60e12700a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.072600 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.073314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.073421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.073709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.074314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.076269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.106160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1353/2714] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:45 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:31:46.110713 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.122438 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fcbc-6a43-4643-bd43-c03758e78e30 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.128403 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.129027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.129294 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.129567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.130214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.131865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.142689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1362/2715] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:46.149879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.160595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d082d8-1f71-4cd1-8f30-5c68d797c045 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.165477 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.166133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.166400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.166676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] PATH_INFO: `/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a/users/2ea9bf80d5c2453e824f01fd15797804/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.178974 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:46.182457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2409c2ef8c7f40ef897f6b6ff4c7c22a, user_id=2ea9bf80d5c2453e824f01fd15797804, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.185576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.199662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1354/2716] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:46 2022] PUT /identity/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a/users/2ea9bf80d5c2453e824f01fd15797804/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:46.203805 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.213915 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adea5dc-a703-432d-853c-9b2c4399d833 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.258886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:46.275029 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.275644 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.275942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.276219 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.276877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.278476 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb369218-4837-4062-9cd2-4ce07ad3f233 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.288435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1363/2717] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:46.292759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.303071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7f350-2c52-4c40-aaf4-241d565f42c3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.308204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.308844 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.309149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.309404 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] PATH_INFO: `/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a/users/2ea9bf80d5c2453e824f01fd15797804/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.311553 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2409c2ef8c7f40ef897f6b6ff4c7c22a, user_id=2ea9bf80d5c2453e824f01fd15797804, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.314236 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.324650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1355/2718] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:46 2022] PUT /identity/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a/users/2ea9bf80d5c2453e824f01fd15797804/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:46.341720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.342008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.342271 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.373022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] MFA Rules not processed for user `2ea9bf80d5c2453e824f01fd15797804`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:46.374244 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:46.451987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1364/2719] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:46.466486 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:46.468379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:46.531350 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf2c25-5aa0-4ac2-be5d-db56de2d79c9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:46.536102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:46.536718 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:46.536993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:46.537259 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:46.598451 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:46.599901 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:46.609071 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1356/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:48.220360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:48.222395 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:48.235204 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e5b29-5421-4b70-9b92-dde18b76c703 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:48.239535 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:48.240159 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:48.240431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:48.240697 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:48.308348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:48.310104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:48.319832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1365/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:48.893079 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:48.902133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd83787-41e9-45d4-b139-41f9f42a6f4e service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:48.907097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:48.908092 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:48.908469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:48.908849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:48.924339 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:48.926656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80050fba-d504-488e-b3b1-cbcd4a118098 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:48.938244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1357/2722] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:31:52.873717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:52.950943 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec730c-9fb5-4f4a-a6a8-4cf3946d086c service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:52.956338 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:52.957072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:52.957352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:52.957470 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] PATH_INFO: `/v3/users/f5b429f885a4410fa5dbb846172b5039` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:52.958688 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b429f885a4410fa5dbb846172b5039)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:52.960696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:52.965931 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:53.017156 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b429f885a4410fa5dbb846172b5039'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.017991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b429f885a4410fa5dbb846172b5039'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.018744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b429f885a4410fa5dbb846172b5039'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.029031 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b429f885a4410fa5dbb846172b5039'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.045932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b429f885a4410fa5dbb846172b5039'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.065030 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1366/2723] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:52 2022] DELETE /identity/v3/users/f5b429f885a4410fa5dbb846172b5039 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:53.070524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:53.071055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:53.071055 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:53.092481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:53.093693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:53.169378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1358/2724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:53.180717 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:53.182404 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:53.275747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52462f-1540-420e-bc7e-deee9925dff1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:53.280891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:53.281754 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:53.282206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:53.282635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:53.295367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:53.296948 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:53.308482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1367/2725] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:31:53.656315 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:53.657987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:53.675740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f782a82-94cf-43d5-98d7-20d6fbd04733 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:53.683312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:53.683763 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:53.684122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:53.684443 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] PATH_INFO: `/v3/projects/ad9202ae49b54b4c8d0b987dd9694bce` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:53.685753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9202ae49b54b4c8d0b987dd9694bce)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:53.687656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:53.707381 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:53.746972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9202ae49b54b4c8d0b987dd9694bce', 'request_id': 'req-6b6d228d-ffe8-436a-af30-275a4e27daaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.754085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9202ae49b54b4c8d0b987dd9694bce', 'request_id': 'req-6b6d228d-ffe8-436a-af30-275a4e27daaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.764333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9202ae49b54b4c8d0b987dd9694bce', 'request_id': 'req-6b6d228d-ffe8-436a-af30-275a4e27daaa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.781984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] The token cache is being invalidate because project ad9202ae49b54b4c8d0b987dd9694bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:53.782498 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.784030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.786115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1359/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:53 2022] DELETE /identity/v3/projects/ad9202ae49b54b4c8d0b987dd9694bce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:31:53.790876 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:53.808862 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad963f-e99b-4680-acd4-4b3ca2a4be7f service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:53.873602 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:53.874238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:53.874822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:53.874822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] PATH_INFO: `/v3/users/292ca1ee6b5b47058cf069152eaf2e30` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:53.875907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292ca1ee6b5b47058cf069152eaf2e30)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:53.877852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:53.908512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:53.929811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292ca1ee6b5b47058cf069152eaf2e30'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.930617 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292ca1ee6b5b47058cf069152eaf2e30'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.931409 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292ca1ee6b5b47058cf069152eaf2e30'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.939983 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292ca1ee6b5b47058cf069152eaf2e30'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.955360 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292ca1ee6b5b47058cf069152eaf2e30'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:53.971243 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1368/2727] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:53 2022] DELETE /identity/v3/users/292ca1ee6b5b47058cf069152eaf2e30 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:54.262605 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:54.264316 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:54.278132 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d228d-ffe8-436a-af30-275a4e27daaa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:54.336652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:54.337219 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:54.337516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:54.337782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] PATH_INFO: `/v3/projects/18a6f3c9a0874d2981602bf448f1832e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:54.338955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a6f3c9a0874d2981602bf448f1832e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:54.340964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:54.391440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a6f3c9a0874d2981602bf448f1832e', 'request_id': 'req-1ca3939d-0380-41bd-95cc-99541ad30d9e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.397454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a6f3c9a0874d2981602bf448f1832e', 'request_id': 'req-1ca3939d-0380-41bd-95cc-99541ad30d9e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.405858 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a6f3c9a0874d2981602bf448f1832e', 'request_id': 'req-1ca3939d-0380-41bd-95cc-99541ad30d9e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.416369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] The token cache is being invalidate because project 18a6f3c9a0874d2981602bf448f1832e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:54.416656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.417290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.418839 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1360/2728] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:54 2022] DELETE /identity/v3/projects/18a6f3c9a0874d2981602bf448f1832e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:54.422944 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:54.424420 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:54.438357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21bd6-4b43-4d0e-8d36-d8c580ff65e4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:54.504817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:54.505496 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:54.505772 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:54.506046 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] PATH_INFO: `/v3/users/2ea9bf80d5c2453e824f01fd15797804` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:54.507260 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea9bf80d5c2453e824f01fd15797804)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:54.509209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:54.561574 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea9bf80d5c2453e824f01fd15797804'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.562283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea9bf80d5c2453e824f01fd15797804'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.562927 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea9bf80d5c2453e824f01fd15797804'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.571135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea9bf80d5c2453e824f01fd15797804'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.588963 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a86ad782-77ce-4786-aab5-9f3c4cbbf0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea9bf80d5c2453e824f01fd15797804'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:54.609105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1369/2729] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:31:54 2022] DELETE /identity/v3/users/2ea9bf80d5c2453e824f01fd15797804 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:54.906869 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:54.908479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:54.923774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3939d-0380-41bd-95cc-99541ad30d9e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:54.957535 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:54.986082 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:54.986796 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:54.987074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:54.987380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] PATH_INFO: `/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:54.988860 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2409c2ef8c7f40ef897f6b6ff4c7c22a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:54.990830 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.039598 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2409c2ef8c7f40ef897f6b6ff4c7c22a', 'request_id': 'req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:55.046140 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2409c2ef8c7f40ef897f6b6ff4c7c22a', 'request_id': 'req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:55.054908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2409c2ef8c7f40ef897f6b6ff4c7c22a', 'request_id': 'req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:55.068012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] The token cache is being invalidate because project 2409c2ef8c7f40ef897f6b6ff4c7c22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:31:55.068304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:55.068960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-feac9f6c-aee8-4aff-a6f7-1968f1e3dac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:31:55.070641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1361/2730] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:31:54 2022] DELETE /identity/v3/projects/2409c2ef8c7f40ef897f6b6ff4c7c22a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:55.076664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.077208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.077208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.099515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:55.100765 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:55.121784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:55.163811 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1370/2731] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:31:55.171871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.172204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.172484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.192342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:55.193260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:55.201864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1362/2732] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:55.206155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.216301 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95e2a-54c8-4ca9-a88b-a4aede76f615 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.223072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.223516 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.223791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.224088 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.224734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:31:55.225038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.226623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.238497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1371/2733] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:31:55.242953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.252706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457767cc-0ecf-4bde-ab01-beafc82cca7d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.259287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.259879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.260174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.260444 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.261073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.262993 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.305595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1363/2734] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:31:55 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:55.310075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.322932 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed71b-3cb0-48bb-a306-13d682a379f1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.382304 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.382914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.383188 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.383437 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.384095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.386003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.408973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1372/2735] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:31:55 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:31:55.413420 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.424287 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bb5e0-b1f4-4a47-964e-437ddc11f5a3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.430304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.430900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.431176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.431438 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.432109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.433716 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.444511 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1364/2736] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:55.449001 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.459542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ba7d-6a90-4ef8-85a5-8367d31481e9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.464962 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.465561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.465839 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.466112 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.466760 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.468397 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474571cd-41c0-46be-8bbe-7db1e113b439 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.479358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1373/2737] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:31:55.484109 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.495940 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01076e-48f5-426c-a6a4-0c7d3122aaa1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.501393 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.502040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.502341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.502610 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] PATH_INFO: `/v3/projects/7b22625545d5472289c2adb376be2232/users/bcd83b79b33b4717967d29e780f3ec7c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.521944 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b22625545d5472289c2adb376be2232, user_id=bcd83b79b33b4717967d29e780f3ec7c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.524826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.540359 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1365/2738] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:31:55 2022] PUT /identity/v3/projects/7b22625545d5472289c2adb376be2232/users/bcd83b79b33b4717967d29e780f3ec7c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:31:55.551023 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.551532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.551891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.580091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] MFA Rules not processed for user `bcd83b79b33b4717967d29e780f3ec7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:31:55.581316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:55.657083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1374/2739] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:31:55.669407 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:31:55.671347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:31:55.731461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa25f4-0948-4e60-a81d-783e90afa497 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:31:55.735655 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:31:55.736288 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:31:55.736563 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:31:55.736836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:31:55.742450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:31:55.746017 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:31:55.747950 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:31:55.757972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1366/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:05.653922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:05.758831 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:20.745187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:20.746852 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:20.821512 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06913c-0992-45f0-9c65-99910f91cc7b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:20.826021 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:20.826625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:20.826925 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:20.827190 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:20.829090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:20.912728 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:20.914168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:20.926587 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1375/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:22.127286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:22.128848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:22.142543 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743742-9381-4bb1-a87d-7f314ed484ad service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:22.147007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:22.147611 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:22.147883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:22.148202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:22.150040 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:22.164052 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:22.165484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:22.177994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1367/2742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:27.612366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:27.621580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62e23-33c5-48ce-8010-befbe9fad498 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:27.625908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:27.626509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:27.626780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:27.627043 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:27.628903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:27.698886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:27.700254 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65ed61-3e52-4a5c-9133-c4bb43f16867 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:27.710068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1376/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:29.119592 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:29.131969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a3d1-351b-435d-8de9-4745878792e5 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:29.139281 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:29.140172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:29.141141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:29.141569 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] PATH_INFO: `/v3/users/bcd83b79b33b4717967d29e780f3ec7c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:29.143346 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd83b79b33b4717967d29e780f3ec7c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:29.147267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:29.202628 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd83b79b33b4717967d29e780f3ec7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:29.212482 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd83b79b33b4717967d29e780f3ec7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:29.213322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd83b79b33b4717967d29e780f3ec7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:29.221546 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd83b79b33b4717967d29e780f3ec7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:29.234703 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd83b79b33b4717967d29e780f3ec7c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:29.241369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1368/2744] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:29 2022] DELETE /identity/v3/users/bcd83b79b33b4717967d29e780f3ec7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:29.246050 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:29.246541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:29.246640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:29.265667 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:29.266909 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:29.304419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:29.339309 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1377/2745] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:29.349285 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:29.351473 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:29.417247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265c23-f4d1-4c68-95dc-74296a4e0aa8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:29.421184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:29.421910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:29.422250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:29.422594 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:29.433778 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:29.435320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:29.446499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1369/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:30.166041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:30.168592 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:30.181011 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d61ac0-7aae-4f39-b0d7-3e89ed6d01b7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:30.187252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:30.187895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:30.188206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:30.188472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] PATH_INFO: `/v3/projects/7b22625545d5472289c2adb376be2232` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:30.189615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b22625545d5472289c2adb376be2232)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:30.191518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:30.249457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b22625545d5472289c2adb376be2232', 'request_id': 'req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:30.258365 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b22625545d5472289c2adb376be2232', 'request_id': 'req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:30.264794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b22625545d5472289c2adb376be2232', 'request_id': 'req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:30.275745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] The token cache is being invalidate because project 7b22625545d5472289c2adb376be2232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:30.276239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:30.277007 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:30.278734 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1378/2747] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:30 2022] DELETE /identity/v3/projects/7b22625545d5472289c2adb376be2232 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:31.087045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.089160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:31.103624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed8ab9-f48c-476b-a267-6307d15c4278 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.161021 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.161654 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.161909 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.162208 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] PATH_INFO: `/v3/users/5305d254a2eb47ec932088b7d75129a3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.163383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5305d254a2eb47ec932088b7d75129a3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.165351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.167681 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:31.218861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5305d254a2eb47ec932088b7d75129a3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.226882 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5305d254a2eb47ec932088b7d75129a3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.228037 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5305d254a2eb47ec932088b7d75129a3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.235220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5305d254a2eb47ec932088b7d75129a3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.246930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27f7d32c-ff19-4b90-9699-1345a239bdff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5305d254a2eb47ec932088b7d75129a3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.252731 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1370/2748] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:31 2022] DELETE /identity/v3/users/5305d254a2eb47ec932088b7d75129a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:31.431906 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.433425 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:31.447036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c8e1a-9a7c-4c6c-871a-fae7ac3c9d90 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.504482 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.505119 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.505376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.505648 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] PATH_INFO: `/v3/projects/98a79cc00fe94102938bd8955b3903d3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.506762 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a79cc00fe94102938bd8955b3903d3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.508689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.556332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a79cc00fe94102938bd8955b3903d3', 'request_id': 'req-504bcd47-bac1-4786-9655-640cc7e18528'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.565507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a79cc00fe94102938bd8955b3903d3', 'request_id': 'req-504bcd47-bac1-4786-9655-640cc7e18528'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.571866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a79cc00fe94102938bd8955b3903d3', 'request_id': 'req-504bcd47-bac1-4786-9655-640cc7e18528'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.573169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:31.584154 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] The token cache is being invalidate because project 98a79cc00fe94102938bd8955b3903d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:31.584459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.585358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-504bcd47-bac1-4786-9655-640cc7e18528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:31.586892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1379/2749] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:31 2022] DELETE /identity/v3/projects/98a79cc00fe94102938bd8955b3903d3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:31.592556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.592835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.593104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.615243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:31.616476 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:31.678107 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1371/2750] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:31.686907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.687297 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.687627 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.707686 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:31.709018 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:31.717573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1380/2751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:32:31.721967 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.733298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce425f78-8156-490d-83cc-0c30b6f5c883 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.738747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.739369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.739643 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.739910 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.740599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:31.740914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.742771 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.755362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1372/2752] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:31.761162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.770851 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86860d-60c7-42c8-b0f2-addbece0bf8e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.775707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.776423 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.776696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.776953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.777614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.779507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.806933 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1381/2753] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:31 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:31.812924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.823268 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cbd6b-a019-46e3-9b83-49b7a790a5e4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.883417 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.884098 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.884375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.884645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.885280 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.887374 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.907400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:31.914691 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1373/2754] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:31 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:31.919185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.929330 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803869a-8a4e-423a-9b0f-f89e02638678 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.934696 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.935326 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.935606 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.935875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.936555 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.938194 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.949004 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1382/2755] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:31.953002 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.963468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7ab5-db9f-46fe-a93d-fb7722f4b9bf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:31.969126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:31.969729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:31.970008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:31.970282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:31.970958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:31.972621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de63381-fcc3-420e-9cfe-5de9e86af675 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:31.983682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1374/2756] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:31.987895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:31.998347 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c993f-928e-44db-9684-5a9307384cd5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.003657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.004374 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.004649 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.004961 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] PATH_INFO: `/v3/projects/199249c4a6244e43868ec1d23680e961/users/503418599d734a9e80271dbf059051ca/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.020539 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199249c4a6244e43868ec1d23680e961, user_id=503418599d734a9e80271dbf059051ca, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.023192 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.038383 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1383/2757] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:31 2022] PUT /identity/v3/projects/199249c4a6244e43868ec1d23680e961/users/503418599d734a9e80271dbf059051ca/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:32.050701 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.050994 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.051282 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.082976 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] MFA Rules not processed for user `503418599d734a9e80271dbf059051ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:32.084238 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:32.150931 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1375/2758] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:32.157044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.224068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e08c27-b69d-4d90-be46-7867faf23507 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.229907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.230799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.231079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.231350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.231982 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.233914 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.264250 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1384/2759] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:32 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:32.268528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.279799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623b753-c80d-4155-a299-4f126173d3e5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.341410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.342027 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.342304 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.342590 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.343196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.345199 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.368319 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1376/2760] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:32 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:32.372700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.383296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb1b7c-44c4-4f42-ba4f-17e50f7be7fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.388135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.388747 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.389012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.389281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.389926 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.391520 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.403251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1385/2761] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:32.409115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.419314 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f487e-708a-42d1-8a76-f3713d360b01 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.424428 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.425068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.425341 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.425693 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] PATH_INFO: `/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca/users/a2b5bee6f92a4e269ffa5d4379c1cfa5/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.440987 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a4ba0e4b09438d9f31ed4ba3e67dca, user_id=a2b5bee6f92a4e269ffa5d4379c1cfa5, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.443621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.458007 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1377/2762] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:32 2022] PUT /identity/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca/users/a2b5bee6f92a4e269ffa5d4379c1cfa5/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:32.461954 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.475773 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748bc13-02ad-4996-af56-390f43392114 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.542578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.543118 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.543396 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.543664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.544341 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.545949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e00db-2117-4b41-947a-9d800cdbe212 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.547171 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:32.557945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1386/2763] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:32.562709 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.573155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343d9bc-d24a-41a4-a272-3ed2e712b4ec admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.580202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.581138 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.581461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.581815 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] PATH_INFO: `/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca/users/a2b5bee6f92a4e269ffa5d4379c1cfa5/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.585001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a4ba0e4b09438d9f31ed4ba3e67dca, user_id=a2b5bee6f92a4e269ffa5d4379c1cfa5, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.589163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.601363 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1378/2764] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:32 2022] PUT /identity/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca/users/a2b5bee6f92a4e269ffa5d4379c1cfa5/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:32.612812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.613090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.613381 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.642239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] MFA Rules not processed for user `a2b5bee6f92a4e269ffa5d4379c1cfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:32.643449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:32.718585 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1387/2765] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:32.730437 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:32.734286 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:32.770618 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:32.798368 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59f08d-42ab-4e27-8cff-500d7b99ed1f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:32.802301 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:32.802904 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:32.803174 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:32.803440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:32.813680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:32.815153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8482a3-d020-45b6-b89f-b4102012e1bb service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:32.824798 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1379/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:33.263123 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:33.334673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf853b7-a6ff-4b2c-98f1-41af6bff5353 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:33.340610 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:33.341140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:33.341390 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:33.341670 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] PATH_INFO: `/v3/users/503418599d734a9e80271dbf059051ca` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:33.342908 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=503418599d734a9e80271dbf059051ca)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:33.344880 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:33.394991 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503418599d734a9e80271dbf059051ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:33.395632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503418599d734a9e80271dbf059051ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:33.396246 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503418599d734a9e80271dbf059051ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:33.403202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503418599d734a9e80271dbf059051ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:33.415193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503418599d734a9e80271dbf059051ca'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:33.426464 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:33.431379 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1388/2767] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:33 2022] DELETE /identity/v3/users/503418599d734a9e80271dbf059051ca => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:33.436645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:33.437189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:33.437189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:33.456398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:33.457596 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:33.524248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1380/2768] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:33.534918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:33.536484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:33.599145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa321d-d535-472f-85c7-ec56009c17ca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:33.603549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:33.604327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:33.604604 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:33.604871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:33.615410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:33.616872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:33.628957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1389/2769] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:33.917059 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:33.918490 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:33.931044 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc43b0d-2762-4613-905c-3396e47bb57b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:33.936705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:33.937353 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:33.937633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:33.937896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] PATH_INFO: `/v3/projects/199249c4a6244e43868ec1d23680e961` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:33.939119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199249c4a6244e43868ec1d23680e961)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:33.941104 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:33.994585 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199249c4a6244e43868ec1d23680e961', 'request_id': 'req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.001395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199249c4a6244e43868ec1d23680e961', 'request_id': 'req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.010216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199249c4a6244e43868ec1d23680e961', 'request_id': 'req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.021658 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] The token cache is being invalidate because project 199249c4a6244e43868ec1d23680e961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:34.021951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.023846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.026599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1381/2770] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:33 2022] DELETE /identity/v3/projects/199249c4a6244e43868ec1d23680e961 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:34.031855 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:34.045022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045217-8862-40b8-9bd6-687d68b7d84d service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:34.109965 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:34.111054 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.111565 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.112096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] PATH_INFO: `/v3/users/a2b5bee6f92a4e269ffa5d4379c1cfa5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.113708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b5bee6f92a4e269ffa5d4379c1cfa5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:34.115661 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:34.166451 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b5bee6f92a4e269ffa5d4379c1cfa5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.167101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b5bee6f92a4e269ffa5d4379c1cfa5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.167689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b5bee6f92a4e269ffa5d4379c1cfa5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.174323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b5bee6f92a4e269ffa5d4379c1cfa5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.186888 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-807fe9b2-2133-47d6-9cb3-09daa064c889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b5bee6f92a4e269ffa5d4379c1cfa5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.202282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1390/2771] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:34 2022] DELETE /identity/v3/users/a2b5bee6f92a4e269ffa5d4379c1cfa5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:34.506836 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:34.508559 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:34.522694 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566116-e7f0-4ee9-97f7-a6fc3bd51aa7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:34.577349 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:34.584980 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:34.585631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.586312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.586635 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] PATH_INFO: `/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.587756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a4ba0e4b09438d9f31ed4ba3e67dca)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:34.590147 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:34.639137 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a4ba0e4b09438d9f31ed4ba3e67dca', 'request_id': 'req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.645399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a4ba0e4b09438d9f31ed4ba3e67dca', 'request_id': 'req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.654054 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a4ba0e4b09438d9f31ed4ba3e67dca', 'request_id': 'req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.665468 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] The token cache is being invalidate because project f9a4ba0e4b09438d9f31ed4ba3e67dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:34.665759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.666390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c1c9f4e8-0fa2-4d3e-98d0-efe31ca0b96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:34.667883 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1382/2772] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:34 2022] DELETE /identity/v3/projects/f9a4ba0e4b09438d9f31ed4ba3e67dca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:34.673266 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.673758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.673758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.692891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:34.694091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:34.711490 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:34.756677 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1391/2773] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:34.765168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.765454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.765749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.787014 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:34.788317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:34.797886 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1383/2774] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:34.802491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:34.812625 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa0f4-e0e8-430f-a4cb-fcf383f35fe0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:34.817689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:34.818322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.818595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.818863 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.819509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:34.819813 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:34.821463 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:34.833607 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1392/2775] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:34.838834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:34.854409 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8f33-3e31-4c37-9c42-077c7166a1cb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:34.862116 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:34.862805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.863119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.863414 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.864073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:34.865998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:34.903211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1384/2776] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:34 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:34.904479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:34.915280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50e1fb-b9a8-49b8-9cc5-0552aab5671d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:34.978129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:34.979342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:34.979620 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:34.979887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:34.980527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:34.982471 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.008155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1393/2777] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:34 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:35.014099 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.025083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c4f09-5022-4ed2-bfe9-5373312c60e3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.030367 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.031395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.031671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.031962 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.032651 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.034245 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.044211 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1385/2778] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:35.048707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.058946 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870c744-3b51-477d-a63d-b44f32252e9b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.064623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.065225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.065477 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.065777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.066426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.068070 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52566-0825-4f26-bb91-d84fb22335e9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.080673 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1394/2779] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:35.085506 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.101524 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e64d9-ced3-420f-ace3-b915a27c4686 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.111522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.112201 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.112478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.112745 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] PATH_INFO: `/v3/projects/6fe55d616a6348019c9ee2fbf6991482/users/06d6161cc5e04461a6e404c7b7c63e5b/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.128801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe55d616a6348019c9ee2fbf6991482, user_id=06d6161cc5e04461a6e404c7b7c63e5b, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.131573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.145781 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1386/2780] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:35 2022] PUT /identity/v3/projects/6fe55d616a6348019c9ee2fbf6991482/users/06d6161cc5e04461a6e404c7b7c63e5b/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:35.158155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.158363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.158634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.186812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] MFA Rules not processed for user `06d6161cc5e04461a6e404c7b7c63e5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:35.187635 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:35.254035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1395/2781] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:35.259126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.328274 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cbfb7-cb43-46c8-8208-778a5844c128 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.333235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.333842 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.334119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.334504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.335128 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.337097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.366729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1387/2782] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:35.372830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.383841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b8d4-8442-4c05-b344-64ed76c8c626 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.396202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:35.441080 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.441638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.441907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.442170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.442781 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.444719 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.472210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1396/2783] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:35.476344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.487877 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22c46d-5848-4b63-b0c5-74aaefba90df admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.493102 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.493732 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.494036 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.494330 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.494971 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.496629 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.497834 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:35.511875 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1388/2784] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:35.513189 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.524116 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5db58c-bb39-487c-8ccb-460f86c512fe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.529725 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.530370 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.530638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.530910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.531541 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.533165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38f1b1-2dde-48d0-9e41-664b5fefd2e8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.543110 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1397/2785] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:35.547001 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.557198 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a781f2-46ca-4c55-9916-85d3e569b1f1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.562308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.562956 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.563213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.563478 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] PATH_INFO: `/v3/projects/5b5389860f3e4e87ba9bc592c757b7a2/users/02096f058f6a4c0c8784a7c77202a66c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.578849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5389860f3e4e87ba9bc592c757b7a2, user_id=02096f058f6a4c0c8784a7c77202a66c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.581555 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.596056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1389/2786] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:35 2022] PUT /identity/v3/projects/5b5389860f3e4e87ba9bc592c757b7a2/users/02096f058f6a4c0c8784a7c77202a66c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:35.606786 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.607074 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.607345 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.636488 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] MFA Rules not processed for user `02096f058f6a4c0c8784a7c77202a66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:35.637716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:35.704631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1398/2787] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:32:35.709224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.775499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bc141-9590-43ce-91c0-7ce09651af58 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.780602 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.781202 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.781475 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.781747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.782362 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.784306 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.812637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1390/2788] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:35.817012 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.827675 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e9c1c-5d0a-4c4a-8d64-588218f2b329 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.888322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.888929 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.889209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.889472 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.890222 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.892165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.916292 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1399/2789] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:35 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:35.920377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.931948 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6240-a7c1-4f64-942f-2515c03f80d7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.937331 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.937921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.938257 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.938528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.939167 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.940813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:35.951650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1391/2790] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:35.956162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:35.966130 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58509e-fa05-4326-9266-074b84ebcef2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:35.971722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:35.972399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:35.972674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:35.972942 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] PATH_INFO: `/v3/projects/d89aee6bd1274b0da74dc653ce93f473/users/4c0c73c83d6c4da59122c77a9826afa8/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:35.985152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:35.988578 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89aee6bd1274b0da74dc653ce93f473, user_id=4c0c73c83d6c4da59122c77a9826afa8, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:35.992202 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:36.007580 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1400/2791] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:35 2022] PUT /identity/v3/projects/d89aee6bd1274b0da74dc653ce93f473/users/4c0c73c83d6c4da59122c77a9826afa8/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:36.011802 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:36.024145 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d6ff2-eaa3-4c14-9d46-e5404772ef2c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:36.085889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:36.086499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:36.086782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:36.087057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:36.087696 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:36.089351 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871848f-d6fb-4be2-8e19-c0f51ebd86f9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:36.099106 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1392/2792] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:36.103508 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:36.114497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d484b06-7069-4d6b-8959-10d7e9c8bb67 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:36.119424 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:36.120109 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:36.120384 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:36.120656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] PATH_INFO: `/v3/projects/d89aee6bd1274b0da74dc653ce93f473/users/4c0c73c83d6c4da59122c77a9826afa8/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:36.122634 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89aee6bd1274b0da74dc653ce93f473, user_id=4c0c73c83d6c4da59122c77a9826afa8, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:36.125359 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:36.136255 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1401/2793] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:36 2022] PUT /identity/v3/projects/d89aee6bd1274b0da74dc653ce93f473/users/4c0c73c83d6c4da59122c77a9826afa8/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:36.146835 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:36.147117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:36.147389 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:36.176433 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] MFA Rules not processed for user `4c0c73c83d6c4da59122c77a9826afa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:36.177626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:36.217216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:36.269149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1393/2794] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:36.280903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:36.282799 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:36.351552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e0dca-eba3-48f3-bc72-dab9578f6596 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:36.356356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:36.356957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:36.357230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:36.357497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:36.367099 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:36.368550 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:36.377873 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1402/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:36.427406 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:36.429826 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:36.449552 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a61dee-0199-4aa4-9b1b-46df1b54c5d4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:36.454661 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:36.455267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:36.455538 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:36.455805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:36.520176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:36.521561 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1f31-5f37-4b29-9a4b-c30b16ac463a service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:36.531225 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1394/2796] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:39.531319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:39.603414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4217b-671e-4c16-9405-88f7340adb50 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:39.611865 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:39.612563 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:39.612832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:39.613096 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] PATH_INFO: `/v3/users/06d6161cc5e04461a6e404c7b7c63e5b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:39.614364 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d6161cc5e04461a6e404c7b7c63e5b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:39.616350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:39.666328 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d6161cc5e04461a6e404c7b7c63e5b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:39.666995 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d6161cc5e04461a6e404c7b7c63e5b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:39.667611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d6161cc5e04461a6e404c7b7c63e5b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:39.674659 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d6161cc5e04461a6e404c7b7c63e5b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:39.686731 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d6161cc5e04461a6e404c7b7c63e5b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:39.696090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:39.700817 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1403/2797] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:39 2022] DELETE /identity/v3/users/06d6161cc5e04461a6e404c7b7c63e5b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:39.705676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:39.706155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:39.706379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:39.726375 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:39.727573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:39.789615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1395/2798] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:39.799674 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:39.801318 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:39.880185 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7a3c3-7ffd-4c3b-8337-94cc8f0b3153 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:39.884886 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:39.885528 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:39.885804 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:39.886071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:39.896588 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:39.898022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:39.908681 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1404/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:40.214838 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:40.216308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:40.230441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bf382-b98a-4f34-9d74-633c370a5418 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:40.237172 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:40.238008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:40.238310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:40.238508 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] PATH_INFO: `/v3/projects/6fe55d616a6348019c9ee2fbf6991482` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:40.240047 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe55d616a6348019c9ee2fbf6991482)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:40.241990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:40.291320 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe55d616a6348019c9ee2fbf6991482', 'request_id': 'req-2faf88f1-f21e-4f64-bc2b-6546979052c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.298073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe55d616a6348019c9ee2fbf6991482', 'request_id': 'req-2faf88f1-f21e-4f64-bc2b-6546979052c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.307400 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe55d616a6348019c9ee2fbf6991482', 'request_id': 'req-2faf88f1-f21e-4f64-bc2b-6546979052c0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.308641 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:40.324604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] The token cache is being invalidate because project 6fe55d616a6348019c9ee2fbf6991482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:40.324921 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.325850 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.328335 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1396/2800] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:40 2022] DELETE /identity/v3/projects/6fe55d616a6348019c9ee2fbf6991482 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:40.333136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:40.343214 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0115b-d5aa-46b6-b76e-72dc10bdbee4 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:40.403935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:40.404579 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:40.404872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:40.405140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] PATH_INFO: `/v3/users/02096f058f6a4c0c8784a7c77202a66c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:40.406418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02096f058f6a4c0c8784a7c77202a66c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:40.408923 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:40.457947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02096f058f6a4c0c8784a7c77202a66c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.458663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02096f058f6a4c0c8784a7c77202a66c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.459323 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02096f058f6a4c0c8784a7c77202a66c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.466985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02096f058f6a4c0c8784a7c77202a66c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.480327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02096f058f6a4c0c8784a7c77202a66c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.494936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1405/2801] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:40 2022] DELETE /identity/v3/users/02096f058f6a4c0c8784a7c77202a66c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:40.784127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:40.785804 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:40.800405 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf88f1-f21e-4f64-bc2b-6546979052c0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:40.862689 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:40.863248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:40.863512 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:40.863782 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] PATH_INFO: `/v3/projects/5b5389860f3e4e87ba9bc592c757b7a2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:40.864997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5389860f3e4e87ba9bc592c757b7a2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:40.866914 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:40.913924 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5389860f3e4e87ba9bc592c757b7a2', 'request_id': 'req-15750ec2-780a-414a-99a8-79308aabbc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.920095 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5389860f3e4e87ba9bc592c757b7a2', 'request_id': 'req-15750ec2-780a-414a-99a8-79308aabbc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.929462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5389860f3e4e87ba9bc592c757b7a2', 'request_id': 'req-15750ec2-780a-414a-99a8-79308aabbc2b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.944231 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] The token cache is being invalidate because project 5b5389860f3e4e87ba9bc592c757b7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:40.944551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.945235 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:40.946767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1397/2802] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:40 2022] DELETE /identity/v3/projects/5b5389860f3e4e87ba9bc592c757b7a2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:40.951575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:40.954162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:40.974930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618f8c4-d429-4b1b-8074-8de2a421e3e7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.004575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:41.050656 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.051279 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.051545 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.051814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] PATH_INFO: `/v3/users/4c0c73c83d6c4da59122c77a9826afa8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.052952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0c73c83d6c4da59122c77a9826afa8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.054891 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.101841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0c73c83d6c4da59122c77a9826afa8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.102481 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0c73c83d6c4da59122c77a9826afa8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.103075 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0c73c83d6c4da59122c77a9826afa8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.110609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0c73c83d6c4da59122c77a9826afa8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.123225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-24e894bd-df39-4d57-adac-dfa194908cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0c73c83d6c4da59122c77a9826afa8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.136114 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1406/2803] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:40 2022] DELETE /identity/v3/users/4c0c73c83d6c4da59122c77a9826afa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:41.440277 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.441719 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:41.455579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15750ec2-780a-414a-99a8-79308aabbc2b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.514999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.515620 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.515889 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.516203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] PATH_INFO: `/v3/projects/d89aee6bd1274b0da74dc653ce93f473` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.517366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89aee6bd1274b0da74dc653ce93f473)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.519290 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.541873 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:41.567908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89aee6bd1274b0da74dc653ce93f473', 'request_id': 'req-7ca345d0-f06a-4885-9e26-5a1c292ec009'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.574183 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89aee6bd1274b0da74dc653ce93f473', 'request_id': 'req-7ca345d0-f06a-4885-9e26-5a1c292ec009'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.583176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89aee6bd1274b0da74dc653ce93f473', 'request_id': 'req-7ca345d0-f06a-4885-9e26-5a1c292ec009'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.594143 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] The token cache is being invalidate because project d89aee6bd1274b0da74dc653ce93f473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:41.594429 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.595085 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ca345d0-f06a-4885-9e26-5a1c292ec009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:41.596908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1398/2804] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:41 2022] DELETE /identity/v3/projects/d89aee6bd1274b0da74dc653ce93f473 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:41.603036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.603392 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.603663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.624834 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:41.626049 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:41.689128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1407/2805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:41.699338 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.699622 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.699929 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.720900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:41.722141 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:41.730898 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1399/2806] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:41.735767 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.746376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b0bee-bef2-432e-9159-58263df7ab43 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.751665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.752282 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.752709 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.752985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.753640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:41.753947 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.755552 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.768608 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1408/2807] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:41.773204 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.782966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd18ea-a40e-43e9-87f9-66845918ad29 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.788797 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.789386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.789806 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.790081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.790710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.792753 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.822634 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1400/2808] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:41.826998 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.837757 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bb3-c013-4c96-aa81-b7e78f10e3f5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.869727 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:41.903378 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.904003 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.904280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.904549 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.905184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.907092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.930158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1409/2809] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:41 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:41.934410 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.944925 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aefece-a19f-448a-868d-a02b093e0421 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.949567 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.950166 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.950440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.950705 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.951345 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.952972 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.963229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1401/2810] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:41.967057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:41.977091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150edd76-0332-4b59-bffe-97efce5fee4a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:41.982534 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:41.983140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:41.983419 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:41.983691 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:41.984405 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:41.986057 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ab7c-0c92-4fa1-9f74-dcebce5d64bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:41.997351 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1410/2811] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:42.001520 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.011955 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b72501-a4f8-4398-bbaa-03fcfcca16f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.017494 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.018214 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.018501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.018780 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] PATH_INFO: `/v3/projects/537466a1f900442099a1e6a1aa68faea/users/02ff13eb263f4bcc8c4809cb5c45d83c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.035791 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537466a1f900442099a1e6a1aa68faea, user_id=02ff13eb263f4bcc8c4809cb5c45d83c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.038505 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.053472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1402/2812] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:42 2022] PUT /identity/v3/projects/537466a1f900442099a1e6a1aa68faea/users/02ff13eb263f4bcc8c4809cb5c45d83c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:42.064822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.065129 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.065400 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.093957 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] MFA Rules not processed for user `02ff13eb263f4bcc8c4809cb5c45d83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:42.095170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:42.162671 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1411/2813] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:42.167489 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.232399 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5569-e7b6-4c7c-bee3-381a0d465df1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.238750 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.239650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.240117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.240440 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.241069 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.243016 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.274371 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1403/2814] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:42 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:42.278658 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.289784 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8509-541a-4219-8d20-a8e40a63d1a5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.350092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.350693 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.350959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.351263 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.351872 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.353823 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.376113 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1412/2815] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:42 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:42.380366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.390627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85773d90-674b-4716-8e78-88c8c7c0c4f7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.396030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.396801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.397186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.397457 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.398153 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.400015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.411754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1404/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:42.416045 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.426446 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b1b9f-5f52-4072-bea9-9fd08ed1a0b7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.431320 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.431993 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.432289 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.432546 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] PATH_INFO: `/v3/projects/dab77cf588484139983ee4484ffc3115/users/2fcb9c4b3cb043f1bac566d727257dc7/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.448551 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab77cf588484139983ee4484ffc3115, user_id=2fcb9c4b3cb043f1bac566d727257dc7, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.451252 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.465407 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1413/2817] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:42 2022] PUT /identity/v3/projects/dab77cf588484139983ee4484ffc3115/users/2fcb9c4b3cb043f1bac566d727257dc7/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:42.469391 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.479470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d0be9-d106-481e-b6a7-ba93091f1f24 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.498469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:42.543151 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.543764 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.544097 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.544366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.545006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.546688 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936925d-b3a0-44ea-a6a5-d095af67f453 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.557421 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1405/2818] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:42.561835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.567479 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:42.573060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd78a1-40a8-4dff-8c1b-9fdde5f3213d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.578878 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.579533 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.579803 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.580165 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] PATH_INFO: `/v3/projects/dab77cf588484139983ee4484ffc3115/users/2fcb9c4b3cb043f1bac566d727257dc7/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.582331 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab77cf588484139983ee4484ffc3115, user_id=2fcb9c4b3cb043f1bac566d727257dc7, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.584971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.597019 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1414/2819] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:42 2022] PUT /identity/v3/projects/dab77cf588484139983ee4484ffc3115/users/2fcb9c4b3cb043f1bac566d727257dc7/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:42.609051 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.609327 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.609615 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.639376 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] MFA Rules not processed for user `2fcb9c4b3cb043f1bac566d727257dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:42.640617 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:42.725902 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1406/2820] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:42.737850 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:42.740283 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:42.802531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdaf40-2162-417f-8c63-34c3dac906b2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:42.809198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:42.810051 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:42.810412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:42.810791 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:42.821638 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:42.823072 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff1ab-72e9-4eaf-8437-ee94d14bc1a1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:42.833144 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1415/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:43.417692 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:43.494908 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ff2b8-8bb8-44fe-afee-2634644c24a5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:43.504269 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:43.504951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:43.505230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:43.505495 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] PATH_INFO: `/v3/users/02ff13eb263f4bcc8c4809cb5c45d83c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:43.506865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ff13eb263f4bcc8c4809cb5c45d83c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:43.508856 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:43.556746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:43.559461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ff13eb263f4bcc8c4809cb5c45d83c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:43.568352 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ff13eb263f4bcc8c4809cb5c45d83c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:43.568965 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ff13eb263f4bcc8c4809cb5c45d83c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:43.575833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ff13eb263f4bcc8c4809cb5c45d83c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:43.587855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ff13eb263f4bcc8c4809cb5c45d83c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:43.593685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1407/2822] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:43 2022] DELETE /identity/v3/users/02ff13eb263f4bcc8c4809cb5c45d83c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:43.598879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:43.599393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:43.599393 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:43.620660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:43.621870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:43.679809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1416/2823] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:43.689690 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:43.691322 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:43.751828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39166fc2-cece-45e6-bb45-3d611240893f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:43.756186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:43.756814 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:43.757081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:43.757347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:43.768746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:43.770504 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:43.780624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1408/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 11:32:44.062769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:44.064319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:44.079092 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb186bf-4259-4003-bef8-a3ffff81e172 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:44.086382 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:44.087040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.087327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.087573 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] PATH_INFO: `/v3/projects/537466a1f900442099a1e6a1aa68faea` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.088840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537466a1f900442099a1e6a1aa68faea)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:44.090758 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:44.140936 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537466a1f900442099a1e6a1aa68faea', 'request_id': 'req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.149090 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537466a1f900442099a1e6a1aa68faea', 'request_id': 'req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.155247 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537466a1f900442099a1e6a1aa68faea', 'request_id': 'req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.165175 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] The token cache is being invalidate because project 537466a1f900442099a1e6a1aa68faea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:44.165460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.166082 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.167559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1417/2825] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:44 2022] DELETE /identity/v3/projects/537466a1f900442099a1e6a1aa68faea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:44.171828 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:44.181934 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a0e1f-06fc-4a5e-9411-3c79f2604452 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:44.242035 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:44.242675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.242954 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.243247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] PATH_INFO: `/v3/users/2fcb9c4b3cb043f1bac566d727257dc7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.244435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcb9c4b3cb043f1bac566d727257dc7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:44.246398 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:44.295963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcb9c4b3cb043f1bac566d727257dc7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.305184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcb9c4b3cb043f1bac566d727257dc7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.306298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcb9c4b3cb043f1bac566d727257dc7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.316662 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcb9c4b3cb043f1bac566d727257dc7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.318906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:44.332917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1fc50320-12f9-462a-b0e6-ded1178698a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcb9c4b3cb043f1bac566d727257dc7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.339577 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1409/2826] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:44 2022] DELETE /identity/v3/users/2fcb9c4b3cb043f1bac566d727257dc7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:44.624741 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:44.626410 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:44.640009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bd0df-e774-44cd-b0c7-ce9310f9b561 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:44.654577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:44.704230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:44.704796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.705079 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.705350 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] PATH_INFO: `/v3/projects/dab77cf588484139983ee4484ffc3115` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.706594 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab77cf588484139983ee4484ffc3115)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:44.708636 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:44.773206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab77cf588484139983ee4484ffc3115', 'request_id': 'req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.782700 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab77cf588484139983ee4484ffc3115', 'request_id': 'req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.789500 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab77cf588484139983ee4484ffc3115', 'request_id': 'req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.800313 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] The token cache is being invalidate because project dab77cf588484139983ee4484ffc3115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:44.800603 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.801715 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-065c96c8-0cee-4fa9-ba99-59d1b2e970b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:44.803324 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1418/2827] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:44 2022] DELETE /identity/v3/projects/dab77cf588484139983ee4484ffc3115 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:44.808587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.809081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.809081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.829521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:44.830747 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:44.891633 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1410/2828] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:32:44.900128 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.900475 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.900826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.924730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:44.925985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:44.935540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1419/2829] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:44.939935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:44.950342 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6ad17-45f1-440d-ad82-8deb72a263a9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:44.956390 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:44.956922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.957205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.957499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.958133 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:44.958459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:44.960119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:44.972411 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1411/2830] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:44.976879 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:44.986996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06c477-4ca9-4541-94d2-2d960e63459d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:44.992896 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:44.993484 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:44.993768 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:44.994086 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:44.994718 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:44.996664 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.029532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1420/2831] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:44 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:45.036329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.048454 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc53c9-5014-45ae-8d4a-c067ad246fc8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.118177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.118784 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.119074 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.119348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.119999 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.121969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.144305 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1412/2832] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:45 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:45.148788 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.159707 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64966ef-909f-4319-bdc8-8f12f8f3b180 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.165369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.165996 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.166265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.166530 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.167170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.168875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.179352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1421/2833] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:45.183514 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.194522 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505e48-83c2-4fb1-8863-2c3c48a91f38 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.199523 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.200188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.200470 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.200746 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.201392 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.202997 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629c1a4-ff74-4d37-a9bc-8d69bfff70a5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.214347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1413/2834] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:45.219065 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.231060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac9a3-f759-425f-81a9-bdce4e16f181 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.236515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.237170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.237595 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.237870 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] PATH_INFO: `/v3/projects/1a9176ee6bac412aa21d2d33dc49f48f/users/51d95b7c0099496d8ee4f999b4de5ff8/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.252427 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9176ee6bac412aa21d2d33dc49f48f, user_id=51d95b7c0099496d8ee4f999b4de5ff8, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.255168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.269615 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1422/2835] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:45 2022] PUT /identity/v3/projects/1a9176ee6bac412aa21d2d33dc49f48f/users/51d95b7c0099496d8ee4f999b4de5ff8/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:45.280423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.280710 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.281015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.309587 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] MFA Rules not processed for user `51d95b7c0099496d8ee4f999b4de5ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:45.310799 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:45.351220 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:45.381203 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1414/2836] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:45.392842 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.395005 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:45.443300 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:45.457632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8f7f-361d-460b-8d94-f7646ca90148 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.462491 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.463105 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.463386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.463660 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.473460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.474889 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c012e-be92-4dda-a252-548fec60ae7a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.485210 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1423/2837] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:45.507228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.584326 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215429db-58ba-491a-93a7-34c74330c3e5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.589333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.589966 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.590243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.590516 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] PATH_INFO: `/v3/users/51d95b7c0099496d8ee4f999b4de5ff8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.591708 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d95b7c0099496d8ee4f999b4de5ff8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.593672 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.653652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d95b7c0099496d8ee4f999b4de5ff8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:45.663599 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d95b7c0099496d8ee4f999b4de5ff8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:45.664244 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d95b7c0099496d8ee4f999b4de5ff8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:45.671218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d95b7c0099496d8ee4f999b4de5ff8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:45.683213 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d95b7c0099496d8ee4f999b4de5ff8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:45.690073 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1415/2838] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:45 2022] DELETE /identity/v3/users/51d95b7c0099496d8ee4f999b4de5ff8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:45.694809 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.695332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.695332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.716568 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:45.717825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:45.784831 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1424/2839] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:45.794977 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:45.796761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:45.856395 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a959a-5318-4518-a0b0-0c6abc8a48cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:45.861169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:45.861777 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:45.862048 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:45.862312 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:45.871879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:45.873380 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029d2e2-e5c5-41f0-aed9-25f35e211957 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:45.878298 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:45.885045 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1416/2840] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:46.185572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.187158 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:46.202864 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508693-e99f-4c04-8280-04624f6a0a75 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.209316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.209981 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.210342 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.210560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] PATH_INFO: `/v3/projects/1a9176ee6bac412aa21d2d33dc49f48f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.211769 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9176ee6bac412aa21d2d33dc49f48f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.213778 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.262600 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9176ee6bac412aa21d2d33dc49f48f', 'request_id': 'req-0f325e6a-3e7d-4462-a926-030152a03e18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:46.270412 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9176ee6bac412aa21d2d33dc49f48f', 'request_id': 'req-0f325e6a-3e7d-4462-a926-030152a03e18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:46.276840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9176ee6bac412aa21d2d33dc49f48f', 'request_id': 'req-0f325e6a-3e7d-4462-a926-030152a03e18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:46.287426 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] The token cache is being invalidate because project 1a9176ee6bac412aa21d2d33dc49f48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:46.287619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:46.288281 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0f325e6a-3e7d-4462-a926-030152a03e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:46.289743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1425/2841] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:46 2022] DELETE /identity/v3/projects/1a9176ee6bac412aa21d2d33dc49f48f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:46.294859 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.295146 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.295430 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.316556 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:46.317774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:46.382126 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1417/2842] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:46.391337 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.391619 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.391934 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.413883 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:46.415104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:46.424418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1426/2843] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:46.428990 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.439267 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b170b4-a47e-43ff-b97c-7cc1ff22bfca None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.445053 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.445680 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.445958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.446228 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.446872 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:46.447176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.448827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.461255 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1418/2844] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:46.465682 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.475439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c87b9-bf9a-42ec-a5ea-ccc417589954 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.480571 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.481160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.481439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.481711 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.482332 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.484621 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.519402 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1427/2845] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:46.523900 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.534156 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266112dd-3327-42b1-b69b-7418f91bbe77 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.594435 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.594960 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.595230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.595509 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.596155 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.598076 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.620714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1419/2846] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:46.682169 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.698115 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39954d5c-1495-4a2b-824c-e9d12c31effa admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.703945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.704575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.704849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.705111 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.705752 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.707372 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.718780 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1428/2847] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:46.723075 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.734120 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d23db9-639b-475c-b14b-ed8e243f703b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.739769 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.740570 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.740679 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.740969 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.741608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.743215 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb37d48-08d1-45f8-9373-e7714826102f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.754700 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1420/2848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:46.759577 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.769844 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11b711-da5c-4b8b-80b2-6e6387198f36 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:46.776137 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:46.776783 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.777052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.777319 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] PATH_INFO: `/v3/projects/dd0e3317ded54480b5120658b32fc71b/users/e01b434e52db4659bf7a4ffc7939cb5a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.793875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0e3317ded54480b5120658b32fc71b, user_id=e01b434e52db4659bf7a4ffc7939cb5a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:46.796567 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:46.812871 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1429/2849] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:46 2022] PUT /identity/v3/projects/dd0e3317ded54480b5120658b32fc71b/users/e01b434e52db4659bf7a4ffc7939cb5a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:46.823442 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:46.823724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:46.824023 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:46.854101 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] MFA Rules not processed for user `e01b434e52db4659bf7a4ffc7939cb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:46.855226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:46.915412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:46.928754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1421/2850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:46.933233 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:46.939145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:47.003307 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7b2d5-8920-41a2-a9fa-ac506efaedb5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.008665 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.009269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.009543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.009810 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.010431 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.012366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.040439 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1430/2851] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:46 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:47.044738 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.055939 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6511-8359-4cf5-941e-eab4349a9988 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.117176 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.117706 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.117986 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.118262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.118905 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.120896 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.147117 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1422/2852] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:47 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 11:32:47.148434 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.158848 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a54043-5259-4502-bd8a-aa779c65a8ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.164435 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.165040 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.165367 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.165632 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.166280 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.167881 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.178609 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1431/2853] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:47.182756 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.193607 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec779c3-b55d-49ba-b16d-3baebb9d4958 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.198378 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.198973 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.199251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.199527 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.200242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.201936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0487a85-2efe-464a-8ff7-1c53f5e1f97f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.218453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1423/2854] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:32:47.220142 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.235510 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff5f60-e21c-4e8e-908c-fafb502dd389 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.242078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.242744 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.243022 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.243295 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] PATH_INFO: `/v3/projects/8c42d9288fb84640a7117273043127a2/users/7ced9e20bf3846269f0151515812fa2a/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.259903 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c42d9288fb84640a7117273043127a2, user_id=7ced9e20bf3846269f0151515812fa2a, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.262589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.276442 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1432/2855] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:47 2022] PUT /identity/v3/projects/8c42d9288fb84640a7117273043127a2/users/7ced9e20bf3846269f0151515812fa2a/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:47.286917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.287077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.287547 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.316230 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] MFA Rules not processed for user `7ced9e20bf3846269f0151515812fa2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:47.318568 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:47.384242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1424/2856] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:47.388935 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.453952 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6b14a-8c27-4948-9fef-5b3da2cb4fa7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.460267 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.460877 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.461146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.461413 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.462036 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.464028 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.494614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1433/2857] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:47 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:47.499105 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.511234 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af53db-11a3-4f73-be1b-bb8f3c8f6966 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.572854 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.573455 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.573735 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.574003 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.574623 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.576580 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.588229 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:47.603656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1425/2858] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:47 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:47.607796 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.620140 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f175747-311d-4a50-8dd8-0b00c041c411 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.625316 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.625917 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.626193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.626459 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.627095 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.628735 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.639971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1434/2859] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:47.644177 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.655358 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50060495-a4df-4f77-aaab-c50d7cdbf491 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.661114 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.661813 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.662115 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.662379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] PATH_INFO: `/v3/projects/ff294c4e77e54d818636b82d3aad686f/users/5a2c9264313f4359ba057fb58baf9ecf/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.677903 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff294c4e77e54d818636b82d3aad686f, user_id=5a2c9264313f4359ba057fb58baf9ecf, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.680650 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.696984 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1426/2860] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:47 2022] PUT /identity/v3/projects/ff294c4e77e54d818636b82d3aad686f/users/5a2c9264313f4359ba057fb58baf9ecf/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:47.701354 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.711907 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20cfac-b3d8-4197-8988-57d300643680 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.741775 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:47.776352 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.776986 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.777256 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.777519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.778162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.779777 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e5cc7-d4bf-43a7-b981-6ea47e3046a1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.789975 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1435/2861] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:47.794348 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.805686 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba600d59-641c-4855-9364-47e9b56f1e2a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:47.810805 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:47.811448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.811723 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.812013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] PATH_INFO: `/v3/projects/ff294c4e77e54d818636b82d3aad686f/users/5a2c9264313f4359ba057fb58baf9ecf/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.813988 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff294c4e77e54d818636b82d3aad686f, user_id=5a2c9264313f4359ba057fb58baf9ecf, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:47.816754 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:47.827571 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1427/2862] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:47 2022] PUT /identity/v3/projects/ff294c4e77e54d818636b82d3aad686f/users/5a2c9264313f4359ba057fb58baf9ecf/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:47.839572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:47.839837 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:47.840176 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:47.878743 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] MFA Rules not processed for user `5a2c9264313f4359ba057fb58baf9ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:47.880527 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:47.952543 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1436/2863] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:47.964483 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:47.966576 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:48.032963 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb4d5-e712-476a-8737-dc917df7af36 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:48.037776 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:48.038373 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:48.038648 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:48.038916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:48.098878 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:48.100573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:48.110119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1428/2864] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:49.646572 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:49.648277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:49.660985 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cf4e1-8b79-4ed5-b777-ddf9c27c1fd3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:49.666032 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:49.667017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:49.667519 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:49.668062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:49.733034 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:49.734820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:49.744887 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1437/2865] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:50.325821 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:50.334793 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea4f04-0b8f-485b-9a06-b32dca185a79 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:50.338612 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d42cfa2d2e9453d879c623cae849ed5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:50.339216 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:50.339499 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:50.339774 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:50.354377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:50.355942 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae3f7-18c1-47c5-9fda-bf4dde8ea7d7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:50.368687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1429/2866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:54.411716 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:54.464277 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:54.480524 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49288-aa21-46a5-8ac4-10a8d6a8911f service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:54.485532 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:54.486631 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:54.487025 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:54.487160 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] PATH_INFO: `/v3/users/e01b434e52db4659bf7a4ffc7939cb5a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:54.488336 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01b434e52db4659bf7a4ffc7939cb5a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:54.490287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:54.545213 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01b434e52db4659bf7a4ffc7939cb5a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:54.546296 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01b434e52db4659bf7a4ffc7939cb5a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:54.547369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01b434e52db4659bf7a4ffc7939cb5a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:54.556830 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01b434e52db4659bf7a4ffc7939cb5a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:54.573684 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01b434e52db4659bf7a4ffc7939cb5a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:54.589630 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1438/2867] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:54 2022] DELETE /identity/v3/users/e01b434e52db4659bf7a4ffc7939cb5a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:54.594847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:54.595453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:54.595453 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:54.614957 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:54.616188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:54.667329 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:54.678664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1430/2868] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:54.688616 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:54.690611 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:54.751730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235f5b6-d98e-4e3b-8fdb-bae8e597c896 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:54.756497 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:54.757178 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:54.757457 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:54.757723 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:54.767892 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:54.769369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:54.779104 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1439/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:32:55.067057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:55.068652 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:55.081461 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2353b5-35f9-4bba-adcb-bdf60ee8488b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:55.087217 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:55.087874 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:55.088180 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:55.088445 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] PATH_INFO: `/v3/projects/dd0e3317ded54480b5120658b32fc71b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:55.089817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0e3317ded54480b5120658b32fc71b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:55.091685 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:55.142775 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0e3317ded54480b5120658b32fc71b', 'request_id': 'req-3baee5db-cd30-4f5a-880c-c307561f628d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.150218 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0e3317ded54480b5120658b32fc71b', 'request_id': 'req-3baee5db-cd30-4f5a-880c-c307561f628d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.160795 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0e3317ded54480b5120658b32fc71b', 'request_id': 'req-3baee5db-cd30-4f5a-880c-c307561f628d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.173186 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] The token cache is being invalidate because project dd0e3317ded54480b5120658b32fc71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:55.173469 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.174262 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.175855 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1431/2870] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:55 2022] DELETE /identity/v3/projects/dd0e3317ded54480b5120658b32fc71b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:55.180168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:55.191009 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb8a2-5ce1-43aa-b02b-4c30a681d26e service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:55.249559 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:55.250193 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:55.250461 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:55.250722 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] PATH_INFO: `/v3/users/7ced9e20bf3846269f0151515812fa2a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:55.251869 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ced9e20bf3846269f0151515812fa2a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:55.254714 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:55.267162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:55.306044 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ced9e20bf3846269f0151515812fa2a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.306974 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ced9e20bf3846269f0151515812fa2a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.307720 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ced9e20bf3846269f0151515812fa2a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.318344 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ced9e20bf3846269f0151515812fa2a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.336523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ced9e20bf3846269f0151515812fa2a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.351148 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1440/2871] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:55 2022] DELETE /identity/v3/users/7ced9e20bf3846269f0151515812fa2a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:55.636949 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:55.638432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:55.652464 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee5db-cd30-4f5a-880c-c307561f628d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:55.711299 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:55.711897 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:55.712196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:55.712465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] PATH_INFO: `/v3/projects/8c42d9288fb84640a7117273043127a2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:55.713566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c42d9288fb84640a7117273043127a2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:55.715484 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:55.770260 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c42d9288fb84640a7117273043127a2', 'request_id': 'req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.776308 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c42d9288fb84640a7117273043127a2', 'request_id': 'req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.784462 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c42d9288fb84640a7117273043127a2', 'request_id': 'req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.794751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] The token cache is being invalidate because project 8c42d9288fb84640a7117273043127a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:55.795030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.795646 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.797175 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1432/2872] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:55 2022] DELETE /identity/v3/projects/8c42d9288fb84640a7117273043127a2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:55.801730 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:55.803239 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:55.816408 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c82439-719c-4c79-a2d3-7806570af2d6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:55.875953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:55.876590 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:55.876875 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:55.877145 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] PATH_INFO: `/v3/users/5a2c9264313f4359ba057fb58baf9ecf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:55.878386 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2c9264313f4359ba057fb58baf9ecf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:55.880348 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:55.928035 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2c9264313f4359ba057fb58baf9ecf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.928745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2c9264313f4359ba057fb58baf9ecf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.929449 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2c9264313f4359ba057fb58baf9ecf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.936369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2c9264313f4359ba057fb58baf9ecf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.949614 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f113a4c-bd68-4325-9550-39754a9562b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2c9264313f4359ba057fb58baf9ecf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:55.964008 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1441/2873] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:32:55 2022] DELETE /identity/v3/users/5a2c9264313f4359ba057fb58baf9ecf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:56.256472 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.257983 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:56.275010 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ec50-967d-4e57-95c3-c5036a7b7d70 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.285432 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:56.338864 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.339551 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.339827 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.340124 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] PATH_INFO: `/v3/projects/ff294c4e77e54d818636b82d3aad686f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.341383 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff294c4e77e54d818636b82d3aad686f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.343401 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.392149 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff294c4e77e54d818636b82d3aad686f', 'request_id': 'req-79c71b92-4ade-4905-a6d5-a141dc69c8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:56.398169 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff294c4e77e54d818636b82d3aad686f', 'request_id': 'req-79c71b92-4ade-4905-a6d5-a141dc69c8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:56.408030 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff294c4e77e54d818636b82d3aad686f', 'request_id': 'req-79c71b92-4ade-4905-a6d5-a141dc69c8ed'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:56.419157 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] The token cache is being invalidate because project ff294c4e77e54d818636b82d3aad686f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:32:56.419560 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:56.420221 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-79c71b92-4ade-4905-a6d5-a141dc69c8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:32:56.421740 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1433/2874] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:32:56 2022] DELETE /identity/v3/projects/ff294c4e77e54d818636b82d3aad686f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:32:56.427832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.428152 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.428444 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.448623 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:56.449832 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:56.454206 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:56.525071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1442/2875] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:56.533422 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.533714 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.534279 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.554365 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:56.555579 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:56.564243 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1434/2876] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:32:56.568814 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.586272 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ca69-a37f-444d-82f0-fa7e5ac07ef6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.594542 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.595209 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.595507 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.595806 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.596593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 11:32:56.597168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.598841 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.613063 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1443/2877] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 17 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 11:32:56.617846 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.628032 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedae0d4-caeb-47b6-9875-bb871bd396b5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.634038 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.634642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.634922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.635189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.635848 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.637849 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.668008 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1435/2878] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:32:56 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:56.672509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.682971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1359-b2cb-4fee-930c-ad71e0aa4a32 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.750135 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.750753 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.751026 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.751287 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.751949 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.753898 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.776945 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1444/2879] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:32:56 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:32:56.781189 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.792917 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeed9e-71ac-4e3a-b086-8c06a2e4eb5b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.799952 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.800631 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.800906 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.801178 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.801809 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.803465 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.814127 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1436/2880] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:56.818237 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.828589 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a0c1-46b3-405e-a5f4-8a7dc9f4cf35 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.834220 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.834820 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.835286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.835536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.836258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.837835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67da8c-d852-49bf-98f8-f8bfef6e7476 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.848557 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1445/2881] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 11:32:56.852935 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:56.863817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12d30-6779-4571-b7ea-aa8e978bc3db admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:56.869467 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:56.870122 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.870372 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.870640 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] PATH_INFO: `/v3/projects/4d0f966b642940d29fb00552dc1b0661/users/c32e3074fb14419b865786335383cc6c/roles/e8695a4f0d9046c58e5c624b69683b8c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.886953 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0f966b642940d29fb00552dc1b0661, user_id=c32e3074fb14419b865786335383cc6c, role_id=e8695a4f0d9046c58e5c624b69683b8c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:56.889624 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:56.904119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1437/2882] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:32:56 2022] PUT /identity/v3/projects/4d0f966b642940d29fb00552dc1b0661/users/c32e3074fb14419b865786335383cc6c/roles/e8695a4f0d9046c58e5c624b69683b8c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:32:56.909640 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3529-0fd1-4737-a075-62288e95a247 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:56.909918 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3529-0fd1-4737-a075-62288e95a247 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:56.910187 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3529-0fd1-4737-a075-62288e95a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:56.933017 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e54e3529-0fd1-4737-a075-62288e95a247 None None] MFA Rules not processed for user `e3e90516d5b04b1aba85684942c89813`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:32:56.934268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e54e3529-0fd1-4737-a075-62288e95a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:57.014537 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1446/2883] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 11:32:57.024711 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:32:57.026871 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:32:57.074852 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:32:57.093459 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dcea-de2f-4960-933d-d68435d6a7e9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:32:57.097807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:32:57.098518 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:32:57.098792 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:32:57.099057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:32:57.111325 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:32:57.114247 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:32:57.128009 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1438/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:01.225797 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.226310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.226414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.257569 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] MFA Rules not processed for user `c32e3074fb14419b865786335383cc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:33:01.259170 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:01.263422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:01.335076 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1447/2885] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:33:01.339742 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.350313 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7933e-3d04-44a5-9115-72cce1db3106 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.355113 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.355879 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.356251 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.356588 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.357295 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.359242 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.389323 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1439/2886] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 17 11:33:01 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:33:01.393523 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.405151 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494f706-576c-4b9d-a209-77d3d2744ad7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.465091 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.465729 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.466016 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.466285 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.467068 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.469071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.493153 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1448/2887] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 17 11:33:01 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 11:33:01.497377 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.508026 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df8fd3-643f-4d1d-8c95-2dad1c1b3a91 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.512841 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.513441 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.513724 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.513998 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.514645 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.516318 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.527154 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1440/2888] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:33:01.531376 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.542930 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df36040-9441-4115-bf80-1b33c545392f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.548027 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.548825 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.549100 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.549369 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] PATH_INFO: `/v3/projects/b9a72cd833084173b5c25b7f11d9aa10/users/621ffec72b6346aeaeaeae7eb4e8329b/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.564972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a72cd833084173b5c25b7f11d9aa10, user_id=621ffec72b6346aeaeaeae7eb4e8329b, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.567840 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.582509 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1449/2889] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:33:01 2022] PUT /identity/v3/projects/b9a72cd833084173b5c25b7f11d9aa10/users/621ffec72b6346aeaeaeae7eb4e8329b/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:33:01.586671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.597119 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d529-8fad-445d-860b-3cbb95519b49 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.661448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.662089 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.662366 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.662637 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.663317 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.665188 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96104bb-9bbd-42bd-9902-12d006d80df9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.676657 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1441/2890] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 17 11:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 11:33:01.681042 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:01.691910 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5ff05-1dfe-45ef-bf35-4e7eb55cf381 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:01.699414 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:01.700238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:01.700694 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:01.700973 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] PATH_INFO: `/v3/projects/b9a72cd833084173b5c25b7f11d9aa10/users/621ffec72b6346aeaeaeae7eb4e8329b/roles/a17fbd5f1a91411583f4436858306f31` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:01.702922 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a72cd833084173b5c25b7f11d9aa10, user_id=621ffec72b6346aeaeaeae7eb4e8329b, role_id=a17fbd5f1a91411583f4436858306f31)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:01.706366 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:01.717377 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1450/2891] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 17 11:33:01 2022] PUT /identity/v3/projects/b9a72cd833084173b5c25b7f11d9aa10/users/621ffec72b6346aeaeaeae7eb4e8329b/roles/a17fbd5f1a91411583f4436858306f31 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:33:06.127964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09a62-8d11-4e44-9e56-0d39e9acf6fe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:06.129253 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09a62-8d11-4e44-9e56-0d39e9acf6fe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:06.129734 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09a62-8d11-4e44-9e56-0d39e9acf6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:06.171626 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ddc09a62-8d11-4e44-9e56-0d39e9acf6fe None None] MFA Rules not processed for user `621ffec72b6346aeaeaeae7eb4e8329b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:33:06.173150 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ddc09a62-8d11-4e44-9e56-0d39e9acf6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:06.262510 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1442/2892] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:33:06.276808 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:06.279038 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:06.342133 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f8d6-4b4b-4ac8-a41a-59e429b94efe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:06.345968 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded8007ff9d64b5b809eef243b8d7895', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:06.346593 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:06.346874 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:06.347146 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:06.358822 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:06.408657 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:06.410251 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:06.419866 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1451/2893] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:06.552912 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c37f-ee7d-4deb-a690-68e57db41c6c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:06.553205 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c37f-ee7d-4deb-a690-68e57db41c6c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:06.553481 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5c37f-ee7d-4deb-a690-68e57db41c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:06.602266 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:06.612801 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-90e5c37f-ee7d-4deb-a690-68e57db41c6c None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:33:06.614479 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-90e5c37f-ee7d-4deb-a690-68e57db41c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:06.686310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1443/2894] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:33:06.736418 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:06.737835 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:06.833624 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3565cd-73a6-4463-a0d5-7a1b052f9242 service glance] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:06.840184 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:06.840793 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:06.841071 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:06.841339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:06.850685 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:06.852327 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:06.860506 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1452/2895] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:33:15.318049 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909bfe-f700-4f76-a508-9dbb4304fb89 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:15.318566 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909bfe-f700-4f76-a508-9dbb4304fb89 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:15.318664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75909bfe-f700-4f76-a508-9dbb4304fb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:15.338861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-75909bfe-f700-4f76-a508-9dbb4304fb89 None None] MFA Rules not processed for user `c32e3074fb14419b865786335383cc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:33:15.340181 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75909bfe-f700-4f76-a508-9dbb4304fb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:15.347450 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1444/2896] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 17 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:33:15.965062 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:15.966582 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:16.037940 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0d43-effb-4f0b-a481-cae3151b0a8f service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:16.043561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:16.044195 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:16.044469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:16.044732 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:16.046522 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:16.058136 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:16.059708 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:16.069492 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1453/2897] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:17.441521 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:17.442056 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:17.442160 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:17.465861 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:33:17.467196 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:17.475057 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1445/2898] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 17 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:33:17.488560 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:17.500462 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa9b8-5d40-4295-bc48-2a103606d573 service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:17.505357 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:17.505959 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:17.506230 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:17.507060 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:17.514794 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:17.516415 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:17.520163 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:17.525356 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1454/2899] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:33:27.459642 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=33 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:27.527468 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:27.812656 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:27.867951 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5412472-ba4f-4c5d-8463-a14083237570 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:27.871573 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:27.872606 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:27.872958 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:27.873224 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:27.875012 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:27.884664 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:27.886083 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:27.896922 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1446/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:28.780198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:28.781858 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:28.881322 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80492-98ef-426d-90f3-157ef5586912 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:28.886884 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:28.887531 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:28.887807 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:28.888101 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:28.890575 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:28.908339 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:28.911970 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:28.928258 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1455/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:34.017200 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:34.032758 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832c14-ac53-4da5-a846-0607c6d1fd1c service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:34.040184 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:34.040807 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:34.041081 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:34.041347 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:34.043270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:34.056333 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:34.057916 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:34.069077 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1447/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:38.917663 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=34 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:41.137518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:41.139162 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:41.151238 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982a2c-625f-40ba-980c-fc0a55a52ce1 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:41.157363 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41154775379d4f0da94e06f8f3fd1455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:41.157971 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:41.158265 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:41.158529 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:41.168310 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:41.169739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:41.179329 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1456/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:42.884310 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:33:42.899006 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cf9ac-ef93-40af-bd2d-fb7f3dbb2e46 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:33:42.906608 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '991c9767714849039e301854775dac09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:33:42.907328 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:33:42.907665 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:33:42.908163 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:33:42.911729 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:33:42.925789 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:33:42.927379 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633925b2-2afa-4b16-bc7c-f71088ba5dd8 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:33:42.938930 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1448/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:33:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:33:51.175225 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:33:52.934996 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=38 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:00.245536 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:00.257540 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131d71b-559f-4a95-812e-007666d083d8 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:00.263561 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:00.264269 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:00.264548 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:00.264826 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:00.266812 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:00.279469 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:00.281013 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:00.292196 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1457/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:36:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:36:01.172671 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56967-f106-4310-8057-82605df61609 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:01.173168 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56967-f106-4310-8057-82605df61609 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:01.173272 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56967-f106-4310-8057-82605df61609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:01.193682 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a0c56967-f106-4310-8057-82605df61609 None None] MFA Rules not processed for user `b0163816d4024a9c81548f4eb0555bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 11:36:01.194884 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0c56967-f106-4310-8057-82605df61609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:01.203296 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1449/2906] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 17 11:36:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 11:36:01.243362 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:01.255466 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48550cd-76a9-4671-b849-929e0acc54db service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:01.261198 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e54d17894648ff81de2b23119732fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:01.261895 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:01.262168 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:01.262429 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:01.270739 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:01.272380 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:01.281052 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1458/2907] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 17 11:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 11:36:04.846687 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56967-f106-4310-8057-82605df61609 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:04.851726 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a0c56967-f106-4310-8057-82605df61609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:04.867817 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56967-f106-4310-8057-82605df61609 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:04.873533 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:04.874250 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:04.874595 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:04.874936 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:04.876833 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:04.889293 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:04.890895 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:04.902915 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1450/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:36:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:36:08.070761 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:08.082208 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf9db-9f6b-40f7-8a84-20ac4c127da1 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:08.087157 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:08.087849 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:08.088174 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:08.088430 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:08.090293 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:08.101745 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:08.103460 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:08.114399 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1459/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:36:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 11:36:08.134751 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:08.201423 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61c154-d1f2-485d-95a5-4086589f8f7c service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:08.206964 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:08.207675 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:08.208025 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:08.208369 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] PATH_INFO: `/v3/users/c32e3074fb14419b865786335383cc6c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:08.209621 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32e3074fb14419b865786335383cc6c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:08.211548 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:08.258448 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32e3074fb14419b865786335383cc6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.266604 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32e3074fb14419b865786335383cc6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.267226 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32e3074fb14419b865786335383cc6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.274068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32e3074fb14419b865786335383cc6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.286206 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32e3074fb14419b865786335383cc6c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.292557 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1451/2910] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:36:08 2022] DELETE /identity/v3/users/c32e3074fb14419b865786335383cc6c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:36:08.484078 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:08.499827 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835fc2c-4105-4026-bec9-56b4d9acb63f service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:08.564262 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:08.565024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:08.565317 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:08.565591 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] PATH_INFO: `/v3/projects/4d0f966b642940d29fb00552dc1b0661` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:08.566790 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0f966b642940d29fb00552dc1b0661)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:08.568989 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:08.622358 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0f966b642940d29fb00552dc1b0661', 'request_id': 'req-ac702929-67be-4112-9776-48d602dda277'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.631953 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0f966b642940d29fb00552dc1b0661', 'request_id': 'req-ac702929-67be-4112-9776-48d602dda277'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.641024 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0f966b642940d29fb00552dc1b0661', 'request_id': 'req-ac702929-67be-4112-9776-48d602dda277'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.655083 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] The token cache is being invalidate because project 4d0f966b642940d29fb00552dc1b0661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:36:08.655290 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.655972 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.657518 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1460/2911] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:36:08 2022] DELETE /identity/v3/projects/4d0f966b642940d29fb00552dc1b0661 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 11:36:08.662015 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:08.663502 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:08.677767 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0bb3d-7752-4e24-b2da-48f4a98ba197 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:08.739018 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:08.740386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:08.740386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:08.740386 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] PATH_INFO: `/v3/users/621ffec72b6346aeaeaeae7eb4e8329b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:08.741412 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621ffec72b6346aeaeaeae7eb4e8329b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:08.743397 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:08.745013 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:08.792270 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621ffec72b6346aeaeaeae7eb4e8329b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.801273 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621ffec72b6346aeaeaeae7eb4e8329b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.802068 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621ffec72b6346aeaeaeae7eb4e8329b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.810676 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621ffec72b6346aeaeaeae7eb4e8329b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.822761 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621ffec72b6346aeaeaeae7eb4e8329b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:08.831344 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1452/2912] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 17 11:36:08 2022] DELETE /identity/v3/users/621ffec72b6346aeaeaeae7eb4e8329b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:36:09.024798 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:36:09.026268 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:36:09.039853 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac702929-67be-4112-9776-48d602dda277 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:36:09.090558 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:09.102515 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3e90516d5b04b1aba85684942c89813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28f251e503a640598b723ca0a0d78c6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:36:09.103155 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:36:09.103417 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:36:09.103689 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] PATH_INFO: `/v3/projects/b9a72cd833084173b5c25b7f11d9aa10` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:36:09.104846 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a72cd833084173b5c25b7f11d9aa10)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:36:09.106819 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:36:09.164422 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a72cd833084173b5c25b7f11d9aa10', 'request_id': 'req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:09.172618 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a72cd833084173b5c25b7f11d9aa10', 'request_id': 'req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:09.179041 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a72cd833084173b5c25b7f11d9aa10', 'request_id': 'req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:09.190059 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] The token cache is being invalidate because project b9a72cd833084173b5c25b7f11d9aa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 11:36:09.190286 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:09.190987 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f9f357b2-c2ab-4813-b47a-66e668b3ccc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 11:36:09.192645 dv-cinder-853450-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1461/2913] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 17 11:36:09 2022] DELETE /identity/v3/projects/b9a72cd833084173b5c25b7f11d9aa10 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 11:36:18.825627 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:36:19.187182 dv-cinder-853450-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 11:41:10.710528 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 11:41:10.712759 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:41:10.866865 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2bec0-e875-44c8-abf3-5a9d64437cf2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 11:41:10.929087 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e843df35ed704a3db7b73ee7678cb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2b0d96bb0c457e997d586501fbb618', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 11:41:10.929847 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 11:41:10.930209 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 11:41:10.930613 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 11:41:10.933749 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 11:41:10.947248 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 11:41:10.948866 dv-cinder-853450-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb7df-13a9-4561-b6a5-493e0f2e8dee service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 11:41:10.959501 dv-cinder-853450-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1453/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 17 11:41:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)